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I, ABSTK^CT OF THE REPORT 



^ Tliis Abstract of th 
• brief ^sj^nunary of the Thi 
f^inneapdlis Career Educa 
discuss the major ob5ect 
Saint Paul. 'and Minneapol 
ology >^a:i' Well as Maj6r 
sfections relate to the ( 
Education Project Jis wel 



project sites, i*ev. Sain 



e RepoW has been prepared to provide a 
rd-Party Evaluation of the Saint Pdul-. 
tiqn Project, Included are sections which 
ives of the Project (provided by both ^ 
is K Evaluation Objectives, and Method- ; 
Fiiidings and Recoihmendations . , These, 
combined) Saint Paul-Minneapolis Careier 
l/^s the Project activities at the, two 
P^ul an\i Minneapolis. * * 



1.1 'MAJOR PROJECT OBJEClriVES 

Major objectives ojf the Sai^it Paul Career Education Project 

have been, stated as follows:^ ' . / 

• # ■ ■ ■ 'J 

1) To begin to 'wftrite ,ins tructional units itiflised with 
career educatfion; - ^ ~- , 



2) Td field tesil car^r-oi'iented iristt^ctional units; 

3) To distributij^ fiedd-tested units; 

4) ^ To plan f or |two (S(|reer-orieirted Secon^ry ^Schp^ 

5) Tq develop |/K-12 Career Education Model in the ' Gemini 
^ , clustQrV anfi 

6) To establisli a close working relationship with the. 
Minneapollg^ Career Education St&ff . ; ^ 

Major objectives of the Minneapolis Career Education Project 



have been fetated as 



1) 
2) 



To establi 
developmen 



To establi 
complement 
studpnt pc 



oXlows: 

h a framework for the infusion of career 
: into the existing K-12 curriculum; 



ph a career guidance program designed to 
the curriculum in developing in each 
jsitive attitudes about the world of work 
and assisting the student in developing career decision- 
making skills,; ; , / 



3) 



To provide^ 
with inseil 
their own 
cepts , an^ 



teachers, both elementary and secondary, 
vice time to prepare them to implement in,to' 
jclassjooms career education techniques, con- 
materials; ^ 



* •■ * .- . ^ ... - . - 4 . -. . ... 

4) To train, a ca^lfe of teachers and counselors who will 

assist a continued inservice training of other teachers 
and counselors • in the district; • [ 

"5) To provide teachers and students with current ajid- com- 
. prehensive inf ormatipft regai;ding careers, life-styles, 
iand career opportunities; . • 

6) . To facilitate cooperation between schools, community, 
and manpower agencies in prbviding. a career-oriented 
program for ^students; ' 



7) To facilitate coixperation between teachers; counselors, 
. and admini? tratbl's in providing a caTe6r-ortented pro- 
gram for students; and ' 

— 8) t5 identify and adapt curriculum materials' which fit 

the career development curriculum framework. ^ V 

1.2 EVALUATION OBJECTIVES AND METHODOLOGY ' ^ 
Objectives of the Third-Party Evaluation , are three-^f old : ' 

1) To determine^ the extent to which the objectives' of the 
project have been accomplished; f 

2) To determine what factors either enabled or prej.uded 

. thfe accomplishment of these objectives; and 

- ^ /■ ' • ^ . ' ' 

J), ^ To promote the inclusion of the ^successful aspects- of 
the project into other ongoing projects . j ^ 

The evaluation has bee^i conducted in three gcomponeht^ or ^ 
phases: l)'The Management Component; 2) The Cur^-icUlum Develop- 
ment/ Inservice Component; and, 3) the Student Coii\poneilt . * 

1.3 PROGRESS ON MAJOR PROJECT OBJECTIVES 

In Saint Paul, progress has been made ^n Major Project 
Objectives 1, 2, and 3. Major Project Objective 4 has been com- 
pleted. Efforts are continuing with Objectiv^'*5, and good 
progress has been achieved with Major Objective 6. ^/ 

In Minneapolis, good progress has beeji made on Major Project 
Objectives 1 - 8 \in the West Area, and district-wide^ thrusts- 
involving theS^ major objectives are anticipated wheVqyer fea^i? 
ble. . - '\ 

■ ' i ■ ■ : . 
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1.4 OTHER MAJOR FINDINGS AND RECOMMENDATIONS. 

» 

Following are brief summary statements of the Findings/ 
ReCommffndations Section of the report: ' * 

* . ' - • " 

' , • Student outcomes measures h^ve served to document growth 
' 1 in career awareness, exploration, and career maturity, 

i as well as positive attitu4es toward tHe world of, work. 



Assistance and encouragemCTit has been rteceiyed from 
DHEW/uSOE^ the Minnesota De'Jjartment of Education, as 
well as the SaiT}t P^ul and Minneapolis Research and 
Evaluation Departments. ' 

• 

A significant amount of community involvement has been 
observed at both Project sites, with specific studerit 
target groups being seVved. / ^ 

Growth and staff development in Career Edlication has 
been evident with a considerable number of inservice 
activities having been conducted/ > ' . 

The projejct shows e^idencd of *cos t-ef f ectivenes^s . 

.A Significant amount of planning/artidiilation between 
^Saintl^aul and Minneapolis^ has b^en evidenced, and 
cooperative activities have been^extended to/the private/ 
parochial schools in- the Twin jGit;J^s Metropd^itan Area. 



More time is iiieeded for Clwer Education planning and 
Inservicing' activities at^ljoth sitjes . 
■ ' > ' - • - J ' J " 
Plans fo;r^futuTe thrusts in Career Education and the 
pl^ce 6/ Careei^Education invboth the Saint Paul and 
Minneapolis Schools n6ed tp be made during the 1976-77* 
.year of* the Project, ♦ Decisions on administrative 
structures, locals funding,, and direction for Career 
Education mist be made in b'oth'^aint Paiil and Minnreap- 
olis in th,^|^ear .ahead. 
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1 1 . PROJECT BACKGROUND 



This secttbn of the report provides pro ject. b^ckgrpund In- 
cluded are discussions of the problem background, goals/objectives- 
of the project, time period covered , previous reporting, and pro-i 
ject procedures. A final sub-section'provides an ov«ervij5W of the, 
remaindep^f . the report. 

2,1' PROBLEM BACKGROUND 

^The Saint Paul Public Schools .was awarded a grant from the 
U.S. Office of Education in summer of 1974 ,to conduct an Exemp- 
lary Project in Vocational Education. The grant, initially plarined 
as a three-year project, is • renegotiated annually ; and i^s con- 
tinuation depends on the availability of funds under Section 442 
(c) of Part D, Vocational Education. Amendments of 1968, P. L. 90- 
576, and on the extent to which the grantee agency is experiencing 
success in achieving . the .,objectives-of the project. The Rules and 
Regulations estabMsning the legal requirements under which the ♦ 
project will be operated read:' ^ 

"Each program or project proposal shall include a^n evaluation 
plan to be carried out by a third party for the purpose of 
evaluating the effectiveness of the program or*project. Such 
a plan shall describe the steps by which the granted will 

.(1) Determine the extent to which the objectives of the 
program or project have been accomplished; 

(2) Determine what factors either enabled or precluiffied 
• the accomplishment of thes^e objectives; and 

(3) Promote/the inclusion of the successful aspects of 

' J the' program or project into vocational education pro- 
grams supported with funds other than those pro- 
. * ' vidjed under the grant." (Section, d03 . 24 (d) , F.R. Vol 

o J9, No. 159) \ ' . ^ 

Accordingly, tjae Saint Paul Public Schibols ,have requested that 
Educational Manag;ement ,Sery^es , Inc. (EMS) pdrform a third -party 
objective evaluation during the second year of project operation. 

2.2 GOALS AND OBJECTIVES OF THE PROJECT 

The major goals of this Third-Party evaluation project are to 
provide documentation in' Several areas of the operation of the 



fill 



tinn Prni ret . inr lurlinr nns. 
ovf> 1 onmon f / i n sY^rv i r i nn ar f i v i 



Saint Rani -Minnrnnnl i s riarnnr Frlnr 
of nroiocf mannf^omrnt' . rurriruliiiti 
fT^%«; and «5tuflrinf outcomes. 

T^e o43jectives of the vthird-party evaluation were developed 
in the context of this exemplary projecfand the U.S.O.E. docy- 
men't, Dra£t Guide'lines for the Evaluatign of Career Education Pro 
grams , (dated August 15, 1974, They Are three-fold : 



IX To determine' the extent to which the objective's of the Pro- 
ject have Been accompjj^ished ; . ' ' 

V 

factors .either j^nabJed 
these : obj ec tives ; ^ryi 



2) 



TJto determine wl;iat 
accomplishment of 



or .preluded th"e 



3) To -promote the inclusion o f^ t hg^^ successful aspects of the 
^project into o^her ongoing projects, 



2,3 TIME PERIOD COV^RER 



^The time period cove-red in this report is the period October 
1975 Juna.1976. The Board of Educatiqn, Saint Paul Public 
Schools, acted favorably on the. Proposed Contract, at its November 
18, 1975 meeting. ^ - 
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PREVIOUS REPORTINjS 



Prior to this report, the Saint Paul -Minneapolis Career , Educa- 
tion Project has received, three evaluation reports. TheXfirst re- 
port, titled, ''First Yqar Report for the St. Paul -Minneapol i5 Career 
Education Projec^,'' dated Sep temtter 1975 , was provided "by a pre- 
vious third-party ^valuator who served the project during' its first 
year, 1974-75. Inclufled were four major sec tions : 

. Introduction 

. Conclusions, Recommendations and Sutnmary of Results 

' . Evaluation Design Summary ^ ^ ^ 

. Evaluat'ion Results . " * , " 

\ 'Educational Management Services, Inc. (EMS) has provided two 
previous evaluation reports since the commencing of its^ association 
with the P.roject as Third-Party Evaluator in Fall, 1975. These are 
1) "Implementation Report," dated December 31, 1975, and "Interim 
Report," dated March 31, 1976. Each of these reports cpuered the 
following topics: . f 

• Period Covered . J ' 

Majojr Activities and Accomplishment^During this- Period 
, Significant Findings and Events \ 
. Problems , ^ * - • - 

. Data . Collection ^ . 



. Progress on Tlvaluation Plans *and Procedures 
.-^Staff Utilization . . . V 

% Future Activities Planned for .the Next Reporting ^Period. 

The current report serves as .an evaluation summary for^ the 
Projects' second year of operation (1975-76.) ' 

2.5 PROJECT PROCKDURES • . / ' 

. QKrerviews of the Project were prepared by both the Saint Paul 
nul MrnneapoliS' Career Education Project Personnel during Fall, 
197.4, in* ac^riJance with' the requirement? outlined in Chapter III^ 
of the doc^ument, Draft Guidelines for the Evaluation of Career . 
.. Education Programs (August 15, J974 .) Summary portions of the over 
vp.ews perttiining to the second year's evaluation are included as*. 
Exhibits at the end of this Report. In addition both Saint Paijl 
and Minneapol is have prepared outlines of the project's evaluation 
needs for 1975-76, .and these outlines are also included' a^ Exhiljits 
supplementary to this report.- ' ^ ^\ 

The major steps of the Third-Party Evaluation Process, fol low, 
and have been deveLoped according to those suggested in the» docu- 
ment. Draft Guidelines for the Evaluation of Career Education Pro - 
grams , August 15, 1974 : ^ . ~ 

1) Prepare Program Overviews (Completed by ProJ'^t Directors;) 

2) Formulate Evaluation 'Quest ions ; 

3) Specify Design; j 

4) Specify Data Sources; ^, 

5) Select or Develop Instruments; 

.•6) Prepare Data Analysis Plan; - . ; . 

7) Prepare Data Collection Plan; ' 
,8) Finalize design and Prepare Reporting Plan; 

9) .implement Data-^ Collect ion Plan; , 

10) Analyze Data; and 

11) Report Findings. 

^ . 

The evaluation plan was desianed to provide a comprehensive 
yet flexible evaluation of the Safn't Paul -Minneapol is Career Educa- 
tion Project. A general design was specified tQ be applied to both 
Minneapolis and Saint Paul, as outlined in- the proj ect * proposal . 
However, the two school dis trie ts vary somewhat,* in terms of their 



to 



resp'ective iictivitios which are rclqtcd to career. i?duca t i on . Thus, 
thfc general design was indivrdual izcd for both Minneapolis and Saint" 
Paul, ^ - 

The fol lowing, aspects of t^hc project's management processes And 
accompli^shmpnts were monitored for Hoth Saint Paul and Minneapolis: 

. Communi ty Involvement - Usage of concerned groups to facili- 
tate access to community resources, • — 

. Technical A i stance - Providing resources used in the pro- 
ject's impl ementat ion . 

^ • Tai; ^ get Group - Identification of the student population* being 
served, - - , ^ 

. ^, Managem'ent System - Used to coordinate project activities,. 

• Stj^Xf Deve lonment - Types of inservice activities which have 
' been or are oeing condilcte^l and methods by which teachers are 
mpt ivated . 

. Cost nf f'CCt i vcness - Ait^lysis of the results obtained in re- 
latibn to the resources consumed. ^ 

* . Articulation - Among and between «fe^el s of education, K-12. 

The Management Component was design^ to answer the folTc^^iji'g 
Saint Paul-Minnesfpolis project evaluation needs, outlined in the 
Exhibits section of this report: 

Saint Paul : . 

Gemini Thrust f • 

Community Resources 

Was there increased staff awareness of community re- 

sources available through the Career Education De- 
partment? ^ — ^ 

To what extent did staff in the Gemini cluster utilize 
Community Resource services? 

District Thrust ^ 

.Curriculum ' , ^ , 

* Was attention given to needs pf minorities ap3 women 
. as related to Career Education materials and programs? 

\ Were inservice workshops provided to enable teachers' 
to open communication with large and small businesses? 

' / ' 

Community Resources ^ / ^ ^ 

Was thfere initial and recurring contact wi^ community 
and busi\i65$ organi za't ions? 

11 . 



The general design proviilcu] n format from which to specify, in 
greater detnil, the particular tasks for each schoof district^, 
per the proposal objectives ^d timelimjs. The work of the evalu- 
ation was proposed in three corfiponents or phascj?: .1) The Manage- 
ment Component; 2) The Curriculum Uevelopment/Inservice Component; 
and, 3) The Stujlent Component, ^ . • 

The rl^m;Mi<d(M^ of this section serves to outline the'thrc^^ 
evaluation componc»nts, including work ;i,c t i v i t i os to accomplis^i the 
objectives of each evaluation component. Likewise, tlie (related) 
project evaluati'bn needs outlined in detail in the lixhibits for 
both Saint Paul and Minneapolis, arfc listed Lrt tlve context of each 
Of the appropriate evaluation components. / 

« 

2.5.1 T he Management . Component ' 

The evaluation plan was designed not only 'to monitor but 
to assist with technical- expertise in d imens iona 1 i 2 ing program 
objectives along specified timelines for the second year's 
operat ion . ' ^ 

Activity : Dimenoionat ize Goala/Obj ec tivea 

This evaluation activity pjFovided technical^a^sistance for 
the implementation of project plans and dimensional ization of 
objectives. 

Activity : n^Monitor Projeat' Plan 

During tie course of Jthe project, HMS used a goal and 
'objective statenrent that evolved from ,thc previous evaluation 
activity to monitor project ac t i vi t i es^t hroughoui the opera- 
tion of the project in both districts. 'The evaluation focused 
on both procedures utilized and timelines specified. ' ^ . 

Minneapol is : * • 

Evaluation. Question No. 5 : To what extend did workshpp par- 
t ic ipants engage in career education" activities after the 
workshop (classroom, curriculum devel>opment , community con- 
tracts?) ' ^ . < , , ' 

Evaluation Question No. ^ : Did the project staff make cVn- 
tracts with community and business otganiMtions? 

2.5.2'* The Curriculum Dev^elopment/ Inservice. Compofient . 

A major portion of the. project activities during the 
second year continued to be inservice sessions with teachers 
and administrators of the school districts.' These were con- 
ducted in ^a variety'of pilot locations in both districts. 



12 . ' 



EKLC 



• • 

' • This activity consisted of extracting from the pr.oject 
, prpposal those objective? which were designed to be Completed 
luring the project's second year of operation. This year's 
evaluation activities have resulted in baseline data having 
if4>een established for staff /ins ervice activirties . 

ri' . . ' . ■ : ; : • ■ .. ,. .1-. ^ 

' Acstivitjy : . Assess Attainment of Curriaulum/Inservn^ae 0b3''eQtvv^S 

The Curriculum/Inseryice Component has" served ta| answer' 
' the following Saint Paulr^linneapolis project, evaluatl^on needs^ 
outlined in the Exhibits: - • • . • 

Saint Paul : ' 

Gemini Thrust ' / \ ' ' 

Media 

Was career-or iented;medi§ developed for primary, 
intermediate, junior high, and. high school as a ^ 
result of career education support services? 

Curriculum 

Was a coordinated curriculum program .developed 
and ^^p],emen^ed? 



Were^ appropr iaW>fe^reer education instructional 
materials for each level developed by Gemini 
staff with assistance of the Career Education 
staff? . ^ . 

Were • teachers in the target cluster involved in 
inservice workshops and other or^ientation to ' 
Career Education strategies and concepts? 

Did the staff make itself and resource' materials 
readily accessible to teachers in Gemini? 

District Thrust- - ' 

Curriculum . 

To what extent w©are teacher developed materials 
utilized by staft in the district? 



Minneapolis : 



Evaluation Question No « 1 : Were inservice workshops in 
career education held for Minneapolis adn^nistrators , 
counselors, and elementary and secondar^^ teachers? 

Evaluation Question No. 2 : How did the participants in 
the inservice workshops react to the conduct, content, 
and activities of the workshops? 

i3 



Eyaruation Qujbs.tion No, 3 : Did the workshop participants 
show increased knowledge and understanding of concepts 
related to.career education? • 



Evaluation (j^uestion }{o . 4 : Did the workshop participants 
show improved at:titudjfes toward career education? 

. Evaluation Question No. 5 : What otlier inservice activi- 
ties were conducted or coordinated by the Minneapolis 
Public School career education pro jedt? 

' • 

Evaluation Question No,- 6 : To what extent was the Career 
Education Resource Center in the Project Office used by 
Minneapolis staff and students, and how useful was the 
' Resource Center to the users? • 

2.5.5 The Student Component 

The Student Component was proposed as ^he most important 
.of the three project work' components." It has sought to docu- 
ment how students who participated in career education activi- 
ties showed improved kndwledge, awareness., an^ attitudes • re-r . 
garding career education. Involved were the documentation of 
evidence relating to measures of career motivation, orienta- 
tion^ exploration, and guidance, ^in both Saint Paul and Minne- 
apolis. During this^ second year *'of the project, major activi- 
ties related to continuing to establish a firm baseline from 
Vrhich future student evaluation activities will proceed. 

Activity : As&rist with Clarification of cognitive and 
^- ' affective, obj ectives relating to student 

out<^ome8y and identify appropriate measures 



This activity" was accomplished in cooperation with the 
Saint Paul and Minneapolis Gareqr Education Project per^sonnel. 
The Draft : Summary of Results,^ Career Education Instrument 
Review Conducted for U,S. ^Office of Ed#at ion , September 5 , 
-1975, provided guidelliies for instrument selection. Utilization 
of parts ofj/Ke Career Ma turity Inventory (CMI) and the Career 
Education Jgurvey were proposed, to link second year survey re- 
sults witn first year eva^luation activities. 



Activity r ^ Administer measurements^ including training of - 

teachers who will administer tests ^ 

'he size and grade levels of the su\)-populations of stu- 
dents were determined in concert with the Saint Paul and Minnea- 
polis project staffs. 



Activity : ' Analyze Survey Data 

• * » 

» 

Analysis results include identification and profiles of 
target and control groups in both Saint Paul and Minneapolis 

■ - ■ ■ « 
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Where appropriate, first-year results have ^een compared with 
those obtained during the second year's evaluati^ activities.. 

^ / ^: . • ^ , \\ 

The Student Component has serv^ed to answer the following 
evilhiation question, ^ outlined in the Exhibits: 

Evaluation Quej%yion No. .9 : ^Did the stude^nts w})0 partici- 
pate<J in intensive classroom act ivitiesjphow improved 
knowledge, awjrreness, and attitudes regfrding career • . 
education? 



2.6' OVERVIEW OF THE REPORT^ 



The_ remainder d£ the report discusses accomplishments , of the 
third-pa^ty e^^alu^tiori project, including conclusions- aTid recommen'da 
tions . The next*^ chapter d-iscusses majoiT; activities, results and : 
accomplishments', for the Saint Paul-Minneapolis combined >proj ect 
and for each of ' the .proj ect- sites in Saint Paul and Minneapolis., 
Likewise, evaluation of the project is discussed in Chapter ly, fol-^ 
lowed by coi^clusions ^nd recommendations in Chapter V. Exhibits 
pertaining /io both the combyied project, as well as each of the pro- 
ject sil^s'i are filed supplement to this report. ^' 

/ ^ . I 
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0 III, MAJOR ACTIVITIES, RESl/LTS AND ACCOMPLISHMENTS 



' i^\i\s Chapter o£ the report discusses^ major ac^tivities ^ results 
and accomplishments o£ the Saint Paul-Minneapolis Career Education 
Project -Third-Party Evaluation during the period October 1.975 
through Juije, 1976. Included are sections- relating to the Isaint 
Paul*Minneapolis (combined) praject as well as^to each o£ the Pro; 
ject Sites, at Saint Paul and Minneapolis, £or each o£ the three 
quarters (October 4975-June, 1976.) ' 



3.1 SAINT PAUL-MINNEAPOLIS PROJECT , 

During the period October-December, 1975, the following mqijor 
activities and accomplishments werl" performed: 

. Following an initial contact with the Administrator, Instruc 
y tional Research and Evaluation , Saint Paul'Public School^, 

on September 11, 1975, EMS met on October 6, 1975, with 
tThe- Administrator, Instructional Research and Evaluation, 
and with the* director. Career Education. Provided was an 
orientation tOo tHMBfipparat ion of a Proposed Contract , 
Work Statemeiit ari8Hpa.ated Exhibits • pertaining to a Third- 
Party Evaluat^-on fo^the Saint Paul-Minneapolis Career 
Education Project-. ^ 

. In e^rly October, 19JS^ EMS reviewed the project materials 
available from its 1974-75 project operation. These in- 
cluded all available interim reports and evaluation sum- ^ 
mari^s and reports. The September 30, 1975 Report, which 
accounted for project activities during the period July 1- 
^September 3Cf, was reviewed in some detail. 

. EMS reviewed the Draft: Summary of Results, Career Educa - 
tion Instrument Review conducted for U.S. Office of Educa- 
tion, dated September 5, 1975. ' 

.EMS met with The Administrator, Instructional Research and 
Evaluation, on October 2-1, 1975, at which time a Proposed 
Contract, Work^tatement and Related Exhibits pertaining to 
a Third-Party Evaluation for the Saint Paul -Minneapolis ^ 
Career Education Project, was transmitted.- The Proposed 
Evaluation included three evaluation components with their 
^ associated activities. Briefly thes« were: 

1 . The Management Component 

1 . 1 Dimensionalize goals/obj ectives 

1.2 Monitor project plan 
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2. "fHe Curriculum 'Development/Inservice Component 



2.1 Dimensionalize ;curriculum/inservice objectiye^ 

2.2 Develop, Instrumentation in interview/quest ioi\naire 
formats to assess inservice objectives^ 

2.3 Assess .attainment of the curriculum/inservice objec- 
tives . • " 

3. The Student Component * ^ . - : ^ 

. 3.1 Assist with clarification of cognitive and aff ec tive^'^v^ 

.objectives relating to student outcomes, and identify /^/, 
appropriate measures , ' . >' 

3.. 2. Administer survey mjeasurements . ' ' 
3.3 Score survefs and analyze surv-e'y data . 

/ EMS met again with the Administrator, Instructional Research! 

and Evaluation, and the Director, Career ^Education on.Npvember 
• 13, 1975, for the purpose, of revising provisions in the 

Proposed Contract, after which the. Board of Education, Saint 

Paul Schools , acted favorably on the proposed contract on > . . 

November 18, 1975 ' v 

During the period November 2*4- 26 , -1975 , EMS accompanied the' 
visit of the jProgram Officer from^ the U.S. Office of Educa- - 
tion. Region V office, icago. Included were meetings and con- 
ferences with a number of components of the Career Education 
projects in both Saint , Paul and ^Minneapolis . These included 
meetings at 360 "Colborne, The Victoria Resource Center, and 
site visitations to the Elementary Career Facility - Un^ver- 
sxty Avenue a*id the Career Resource Center - Mechanic Arts, 
all in Saint Paul. In Minneapolis^ conferences were held \ 
at the Educational Service Center,, at the Harrison School, , 
at West High School, at the' Career Resource Office for. the 
Project, in the Ftflton School, and with persaijnel from the 
Office of the West Area Superintendent. 

. During December, 1975, EMS has^reviewed all available 

materials and completed evaluatie^n materials' relating to both 
the Saint Paul and Minneapolis components of the Rroject. 
Preparations were also made for a January 5, 1976 Qonf erence 
with The Saint Paul Career Education Staff at t^e Victoria 
Resource Center. 

. EMS completed an Evaluation- Plan« Summary Chart and it is • 
included in Exhibit 6.1 (filed supplement to thi-s report-) 
Evaluation purposes/goals and needs for the Saint Paul and 
Minneapolis components are provided in Exhit)its 6.2 .and 6.3 
respectively. o • 



^ During the period January-March, 1976, the following maj 

-^r.A vac tivi ties and accomplishments were performed; 



or 
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During January, EMS reviewed^ the' Quarterly Report dated 
December 31, 1975 and prepared for the Saint Paul -Minnea - 
polls Exemplary Career Education ' Proj ect , for the period^ 
Octpber 1, 1975 - December '31, 1975. * • / . , 

. ' . . ; ' ' s ^ ^ ' ^ 

On January 26, EMS met with the Minneapolis 'and Saint Paul 
Career Education -Project Staff at tjie Fulton Resource Center 
to discuss %dditi^jiaj evalaati'on approac^heS and to schedule 
evaluation aptivities, as well as to discuss .joint activi*^ 
ties. assoc;rated with the combined Saint Paul • mnn*eapo;.lis 
.Career Education Project. 

X • — ^ 

Durip^the period February 8-10, EMS attended t?)e Second* • . 
Caj>eer Education forym, in Washington,, D.C,^ -also attended 
a staff member from both Saint Paul Public Schools an4_ 
Minneapolis Public Schools. ^ • , ^ 

On March 5, EMS, along with the Saint Paul and Minneapolis 
project directors, conferred .with Midwest office reptesenta- 
•tives of CTB-McGraw-Hill, relating to use^ of . the Career 
Maturity Iiwentory. (CM^> in the secondary sectors /of both 
Saint* Paul knd Minneapolis. . . 

. On March 16, EM'S, cdnve^ned a jneeting of the Administrator , / 
Instructional Research and Evaluation, andC the^ Sainft/Paul 
•and Minneapolis Capper Education Project Directors', for 
purposes, of/ coordinated ||ttanning for a total evaluation 
effort ^at ^t4ie two proj ect si1::es . ' 

During the period Apri 1 - j'une^, 1976 , the foilowing major 
activities aad accomprlshmients were performed: ; 

■ ' ■■ . " ' • ■ 

. During this perioH May '6- 7 / 1976 , ^MS participated in the 
site review visit o:^ the -Pjogram Officer from the U.S.( 
^ Office of Edutation, Region V Office, Chicago, and »th^\ 
* Demonstration Bran^K Chi^f,>. Bureau of Occupational and Adult 
Education, DIIEW/USOE, Washington, D.C. Included were major 
EMS presentation;^,, at each of the project sites, including 
.preliminary obserVrftis^ns on the Saint' Paul-Minneapolis 
Career Education Project, as'^wej.l- as project operations at 
both the Saint Paul' and Minneapolis sites. - — 

. ^On, May 26, 19J6 , EMS piet .with a Saint Paul . Jlinneapolis/ 
meeting of Carreer Education Advisory GomiTii^i^Sjs, duriag 
which EMS presehted' the major agenda i teni/^B^j^^^sress report 
on the combined proj ect and career education ac^Yi\t^'es and ^ 4> 
evaluation fin^ijngs ^l^ of the. project sites 

» During- June; 1976, EMS has prepared the Final Report, for tlje >. 
1975-76 year,, relating to the Saint Paul -Minneapolis Career' 
Education Project^ an Exemplary Project in Vocational 
Education, conducted un^der Part D of Public Law 90-576. 
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3.2 SALNT PAUL PRO. 



During the per 
activi tries, and act'" 



On December sf 
Monal Resear 
Education, Sa 
of eyaluatio 
Project. 



ECT SI/TE J . 

ipd October -December , 1'97'5' the following Jnaj or 
on^li^hmehts were, performed : ^ 



, 1975, EMS m^t with the Administrator, Instruc- 
h and Evaluation, ^nd with personnel in C^r-efer. 
nt Paul Schools, for the purpose of planning 
activities for the Saint Paul component of the 



During the perflod January-March, 1976, the following, major 
activities and^accofiDlishments were perfprmed: 

On January Sjf, EMSljnet with the Saint . Paul Career Education 
Project Staf/f to. explore approaches .to evaluatic^ activities 
and to >i;-evi/lw the purposes and goals of the project, the 
evaluation filan summary chart, and ±he evaluation needs, 

• .On. January |i29 , EMS met with the Administrator , Instruc- 

t ional R^es/Jarch and Evaluation and* the .Career -Ediic^tion / - 
Pro j ect , DitfeQtor to discuss city-wide* administration of 
career erfufcation evaluatioii instrumentation. 

On^ March i6,- EMS par.ticipated in the Career Education Fair 
at\the Viekx Side Boys and Girls Club, Saint Paul. 

[■"''■ , . 

On March; 30 ,. EMS conferred with members of the Saint .Paul 
Cajreer Education Project Staff, relating to specific ev^lua- 
tioh activities associated with the Career Education Re- 
source /Center , Victor ia School. 

Ampng/evaluatioji, iiistruments which were adminis terefl as part 
of the Curriculfaift DevelopiTient/Inservice Component were the 
Saiilt Paul Schools Career Education Resource . Center Qiies- 
ticmnaire: Career Education Services. 

i * - ' 

Acmohg the evaluation instruments- which werie administered as 
Tart of the^ Student Component was tj^ig^Clareer Maturity In- 
ventory (GMI/) ' ' 

Di/ring the period April- Juije, 1976, the following major activi- 
ties add accomplishn^ents were performed: 

On April 9 and 19, EMS met with th'e Carreer Education Staff 
for the further planning and performdnce of evaluation 
activities . ' . ^ ' - 

On Aptil 26, EMS performed interviews with teachers at the * 
Career Learning Centers, including those in secondary schools, 
as 4^ell as community resource personnel who cooperate with 
the Sai^it Paul Career Education Project. 
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. OnrjApril 29, EMS met with the Career Education Advisgry Com- 
,nii4:tee^ related to Gemini Cluster Career education activit^es^ 

On June 15, EMS met, With personnel in the. office of .the Ad- ' 
'mlnistra^:or. Instructional Research and Evaluation, relal;ing 
to district wide survey results • 

3^.3 MINNEAPOLIS PROJECT SITE tw. 

During the period October-December, 1975, the f olldwiitg^ ma j or 
activities and accomplishments were performed: V 

. On December 11', EMS met with 'the Project Administrator ax 
> Career Specialist of the Minneapolis component of ' the Pj 
ject for purposes of obtaining a detailed orijKtatioi 
Minneapolis Project. • ' ^ 

Dii^ring the period Januafy-Marph , 1976, the following major 
activities and accomplishments weje performed: 



. . During January, EMS wa^' invited to join the Minneapolis 
^'Career Education Advisory Committeee, an invitation /which - 
'■^ was accepted. 

. February 4, EM3 made a presentation to the Minneapolis 
Catfeer Educiition Advisoljp Comirtittee relating to evaluation 
activities, during the 19T4-75 year and early in the 1975-76 
r?feyear|r^ (both*^ of which periods pre-dated the involvement of 
EMS a:jj Third-Party EvaluatOr.) 

. On February^ 13, EMS met with the Minneapolis Career Educa- 
' ' tion Project Staff and with Minneapolis Public Schools, 
* : f Research and Evaluation, relating^ to evaluation instrumenta- 
tion fpr~^4se- with' students (elementary and secondary) and * 
•.with sftaff > Ijic4u,dad were considerations: of evaluation 
activity scheduling and sample size. • 

. Among ^jKe evaluation instruments which were administered as - 
part o|; the' Curriculum Development/ Inservice Component were 
the Career Education Teacher Survey. ^ . 

■\. , Among the evaluation ins trulffelits whicfr were administered as 
part of the Student Component wfere the Career Maturity In- 
ventory (CMI)' and the^ Career Education Student Survey. 

During the period April-June,* 1976, the following major activi- 
ties and. accomplishments were performed: 

."On April 5, EMS met with the Project Administrator and Career 
Specialist for purposes of obtaining . both staff and^ student 
data relating to the Minneapolis Site Evaluation. 
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• On April 8, ENIs met with the Minneapolis Career Education 
Advisory Committee. 

4 Oh April 9, EMS and the Minneapolis Project Adm^i^trator met 
with guidance and teacl^ing personnel at two senftr high 

..schools to arrange for administration of the Career Maturity* 
Inventory- (CMI) during- the post-spring vacation period- 

. pn May 17, EMS met' with the J^inneapolis Career Education 
Staff for the purposes of additional data collection. 

^ ' .On June 23, EMS met with the^inneapolis Career Education 
• Staff to .procure additional evaluation data, including staff 
activities and, materials logs vhich were, maintained during 
the* 1975-76 project operation. 

* " . ^' ^ 

This third-party evaluation project ^^s requir^ a great 

deal of process activity in this first year of 'eMS participation 
with the project. Involved are two separate school districts 
(Minneso*ta* s two, largest) , as .well as^ the Saint Paul-Minneapolis 
(combined) project itself. Totally ,;tH'ree'^.off ices 4n Saint Paul 
and two oflfices in Minneapolis have interests and concerns with 
the projecT. In addition^ two advisory committees are' involved. 
A major amount of coordination necessitated project time ex-, 
penditure. on the part of tne Third-Party EvaluatoV, a requirement 
which may likely be lessened in a second year of' ^^volvement. ' 
Evaluation activi ties/c(^ordinafrion Have contributed to Saint 
Pkul-Minneapolis cooperation during 1975-76. Evaluation of pro- 
ject outcomes isiii^cussed in^Chapter IV, Evaluation of the 
Project. ** ^ 



. ■ ' IV. EVALUATION 'loF THE PROJECT » ' 

This chapter of the report discusser the Third-Party Evalua- 
tion activities relating to the Saint Paul-Minneapolis ^Career Educa 
tion Project. Included aie three major sections, relating/ to: 

^? 

(4.1) The (combinedj Saint Palil-Minneapdlis Career Education , 

' Projects ^ > ^ ^ ' 

(4.2) The Sainx Paul Career Education Project; and 

(4.3) ^The Minneap^Jis Career Education Project. 

For each of th^/:^regoing aspects of the total project, the 
evaluatidri objectiveSOmethodologies, and major filldings are pre- 
sented. Conclusions and recommendations , based upon these evalua- 
tion activities, are discussed in Chaptef V- 

- ' . . ■ • ^ ■ -.. ■ ^ . \ 

4.1 SAINT PAUL-MINNEAPOLIS CAREER EDUCATION PROJECT ° 



4.1.1 Evaluation Obj ecylv es and Plan- 



As stated in Chapter II, the objectives of this Third- 
Party Evaluation were : ^ \ ' 

' ^ 1 " 

1) To determine the extent to which the objectives of the 
project (and i^s components) have been accomplished; 

2) To determine what factors ,eii:her enabled or precliidedj the 
accomplishment of these , obj ectives ; and 

3) To promote the inclusion of the successful aspects, of the . 
project (and its components) into programs supported with 
fu(p4s other than those provided by the grant. 

The evaluation plan .was designed to provide a comprehensive, 
yet flexible, evaluation of ilhe Saint Paul -^Minneapolis Career 
Education Project.' A general design was specified and applied 
to both Minneapolis and Saint^^^Paul , as outlined in the project 
proposal. Hovever, the twcT school districts vary considerably, 
in terms of thefir^ respective activities which relate' to career 
education. Thus, tjie general design was individualized for 
both Minneapolis ^nd Saint Paul. The general design provided 
a format from which to specify, in greater detail, the par- 
ticular tasks for each school district, per tiFie proposal ob- 
jectives and timelines. The Work of the evaluation was pro- 
posed and conducted in three components or phases: 1) The 
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Managemei*it Component; 2) The Curriculum Development/Inservice j 
Component; and 3) The Student. Component. 

The major stfeps of the Third-Party Evaluation Process fol- 
low^, and w€re developed avoiding to those suggested in the 
document,. Draft Guidelines .for the Evaluatian of Career Educa -_ 
tion Programs , dated August 15, 1974 : 

* ■* • 

1) Prepare Program Overviews CCompleted^ by Project Staffs); 

2) Formulate Evaluation Questions and Prepare Evaluation Needs 
Statement; ^ 

3) Specify design; ' • 

4) Specify Data Sources; ' 

5) Select or Develop Instruments; 

6) Prepare Sampling Plan; ^ J 

7) Prepare D^ata Analysis , Plan ; j( 

8) Prepare Data Collection Plan; 

9) Finalize Design and Prepare Reporting I|lan; 

10) Implement Data^Collection Plan; , 

11) Analyze D^a ; and^ 

12) Report Findings*. J ' .: 

The major, sources >of evaluation data utilized in thl^pro- 
ject relating to the (combined) Project as well as the Saint • 
Paul and Minneapolis sites, included: 

. Background materials^ including' Proj ect Proposal (s); 

. Student measures, b^th cognitive and affective; 

. Staff measure^ to d^eterfhine both knowledge oj^ and attitudes 
toward, career .education ; • 

Survcys/logs/gther records to determine staff utilizatioJi of 
Career Education Project Personnel and Materials; 

. Interviews with Staff, including teachers and administrators , 
, and community resource persons ;- 

I . Other existing data relating to career education- implementa- 

tion in both Saint Paul and Minneapolis; and 

- Monitoring of operational aspects of the (combined) project. 
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4.1.2 - M/jor Findings i|| ^ J 

The/major findings reported in this section relate! to the 
' (combined) Saint Paul-Mijineapol is tiareer Education Project. 
In particular, those* finaings generated as. a result of the 
Management Componervt of the Evaluation Plan are discussed, s>nc^ 
the (combined^) Saint Paul-Minneapolis Career- Education p'roject 
was evjaluat^ in terms of its management aspects only. The/ 
two project site components, (at Saint Paul and MinneapolLs). , 
were evaluated in the context of all three of the ^valua-tibn 
Plan Components" (i. e. Management , Curriculum Developmeijt/In- 
service and Student;) See Exhibit 6.1.1 which includes the 
Evaluation J>lan Summary Chart. Sections 4.2 and 4.3 serve to 
report these 'findings for^each project site. Following are the - 
major findings related to the (combined) project: 

Saiflt Paul -Minneapolis Cooperation 

The*Saint Pfeul-Minneapolis Career Education Project has 
fostered a number x>f cooperative rel^Htionships between the two 
' lai'gest school districts in the State of Minnesota. Evidence 
of cooperative relationships have been found in a numbei^ of 
activities, including^: ' v 

1) Exchange of career education modules and^other materials; 
12) Joint Staff Conferences; 

3) Joint Adirisory Committee meeting; 

4) Conduct of workshops in the Saint Paul -Minneapolis communities 
and in neighboring public and private schools; 

5) Summer seminars; 

6) Joint use of evaluation instruments,; 

7) Plans for a metropolitan area career education "swap shop;" 

8) Joint participation'' in the Career Education Forum, 
February 8-10, in Washington, D.C. ^ • 

» 

Assistance to Private Schools 



The Saint Paul -MinneapoMs Career Education Project has 
established a liaison with priirate schools in the area, in-- 
eluding parochial ^schools in the Saint Paul-Minneapolis Arch- 
diocese. 

* . . * 

(^mnyuni ty Involvement ^ 

T^ere is evidence of the utilization of concerned community 
groups^o facilitate access to community resources. Both the 
Saint Paul and Minneapolis Components have developed liaisons 
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with their area Chambers 'cj^T^ommerce , as wei:^ as with other 
groups in labor, commerce and industry; 

\ 

Technical , Assistance Utilized 

Both, project components have sought atid benefitted from 
technical assist.ance*provided by a/number of agencies, in-' 
eluding their Research.and Evaluajbloh Departments , ,*IIEW/USOE, 
(both Region V^^tid Washington,n).C, Offices;) the Minnesota 
- Department .of EJlucatiori (Vocational -Technical Division, and the 
Career EducatioiCCobrdinator, Instruction Division) , the 
University'of Minnesrota, and the) Third,-Party Evaluator • 

Target .Group Served . — 

Both: the Saint P^ul and Minneapolis components of the*. • 
Project have identified target' groups of their school district 
student populations to' be served; including the West Area of 
Minneapolis Public Schools and the Gemini Cluster of Saint 
Paul Public Schools; ^ 

Management System Established ^ 

• Th^ (combined) project, as well as its Saint Paul and 
Minneapolis Components, have developed management systein(s) to 
coordinate the planniiyg, implementation, and reporting of pro- 
ject activities and -pryoject spending plans'. / 

\ Staff Development 

Both components of the Project have -been involved in a 
variety of inservice activities*, which have been dei|||ned to 
inform and to motivate teachers and other stjff in the process 
of infusing career education concepts with cMping curricular 
activities . * " 

€ost Effectiveness 

Evidence of cost effectiveness have been found in the 
operation of both the Saint Paul and Minneapolis, Components 
reported in the ^riext s.ections of this report. Mention is 
made of the- following examples: 

Utilization. of (voluntary) Advisory Committees , 

Use of community resource persons; 

Use of aides at resource centers, including C.E.T.A. - 
paid aides ; 

Utilizatian of existing personnel who go directly 
to teachers , students , and librarians (non-use of 
••add-on'' personnel) • 

r 

r 
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Articulation 



In both school d^^^tri'cts , evidence was founjl of articula- 
tijOn/cooperation between ^atid amiing levels of education, K-ll. 
The organization, function and location of Career Education 
Project Staffs has largely contributed to tihis outcome . In 
addition, both the- Saint Paul and Minneapol is . Components of the 
Project have related well to their Departments * of Instractiori} 
to Vocationa4y Technical and jfndustrial Education , to Guidance/. 
Counseling Services, and to '^pec ial J^^d§. Ed^ within 
their, respective school systems. TM^^& Appears to be no schism 
between career education. a||d vocational Education in Minnesota ' s 



Twin Cities 



Advisory Structure 



Both of the Twin City Components have estaBli.shed advisory 
'structures for purposes of project planning, implementation and 
evaluatioo. * Each qf the Advisory CoJmriititees has been consis- 
tently active and instrumental in >a$^^^^pg pro j ect personnel.- 
A joint Saint Paul-Minneapolis CarenP^^^K Vocational Education 
Advisory Committee session- was he^d. olffl^y 26; 1976, at 360 

--Colborne, Saint Paul. The agenda "for 'i^^^^S meet ing is found in 

^ Exhibit 6.1.2. ^ ' ' .V 

— . V/ ' ' ■ ■ ' :■ ■ 

SAINT PAUL CAREER EDUCATION PROJECT • 

4.2.1 Evaluatio*n Objectives and .Plan 

^The ^ evaluation objecti\;es and plan^ discussed in section 
4.1.1 was applied to evaluation activities related to the 
Saint Paul Component of the Project. During^thig 1974-75 year 
(the first year of the project* s operation) ,- student outcomes 
baseline data- were .established system-wide • as a result of 
leadership on the part of the Adminis trator ^j^jfe^ 
Research and Evalj|dtion. These data collecfelori and analysis 
efforts were continued durihg the 1975- 7^y^r, anci.staff base- 
line data collection, relating to the Curriculum Development/ 
Inservice Component of the Ev-aluation Plan was established. 

4 . 2 ! 2 Major Findings: Management Component ' 

A number of major .findings relating to the Management 
Component of the Saint Paul Career Education Project are found 
in Section 4.1.2. >In addition, the following findings may be 
summarized for the Saint j^ul Project: 

Access to Community Resources 

the Saint Paul Career Education Project is an outstanding 
example of seeking of acceptance and support from key community 
groups, representing commerce, labor and industry, including the 
capability to orient and train community resource people to 
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insure und^JP^tandings of their roA| || with respect to the pro- 
gram' s educational objectives. 

^ ^Service to Targeted Groups 

The Saint Paul Career Education Project has exerted leader- 
ship regarding roles bf minprities and women in the imple- 
mentation of career education itrategifes- Demonstration pro- 
ject applications have sought to eliminate and avoid sex bias 
and sex role^stereotyping. . 

. Staffing Capabilities , 

The Sfi^t Paul Component exhibits staff in^l^pabiliti^ 
i^with a numKir of areas o£f*xpertise and a good^^eal of iTqflpna- 
tion in approjiches to the planning and implementation of career 
education thrusts. ■ \ ■ ■ . ^ , 

Servicing Schools System-Wide 

The Saint Paul Staff had developed a district-wide thrust 
in approaching Career Education strategies, including the :i 
establishment of career education centers, in the various schools 
which are serviced by^ the Career Educatioii Resource Center at 
the Victoria School. ^ ^ 

. Utilization of High School Follow-up 

Saint Paul Public Schools has been successfully utilizing 
the High School Foll,ow-Up Questionnaire, developed by the 
Minnesotj^ Research Coordinating Unit for Vocational Education, 
Department of Vocational and Technical Education, University 
of Minnesota. This system is assisting Saint Paul Public 
Schools in local assessment procedures reg^arding^^^^^^ status of 
former high school students, inclj|ding -employment activities. 
Minneapolis Public Schools is also considering the use of 
this management tool, which has great potiential ftJr use in the 
^planning and development of career education thrusts. 

4.2.3 Major Findings: Curriculum Development/Inseryice 
Component 

A number of Curriculum Development/Inservice Component 
Findings may be summarized for the Saint Paul Career Education 
Project, including those related to seminar/worJcs|M)p revaluations , 
the utilization of Career Education Resource Center Services, 
and special projects at the Career Development Center. 
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• "The Woman in the Gra^ Flannel Suit" Seminar ^ 

During Summer, 1975, the Saint Paul Career Education 
staff conducted an inservi.ce activity entitled, "The Woman . 
in the Gray Flannel' Suit". In F.ebruary, 1976, a follow-up 
questionnaire was sent to a number of the seminar partici- 
pants. A copy of the questionnaire and its major responses 
may be found as Exhibit 6.2.3. Of those who responded to 
the questionnaire, 100 percent suggested that a similar 
seminar be conducted during Summer, 1*8'^^ (Incidentally, a 
seminar of this type is being conducted dlN^ing Summer, 1976.) 
•Seventy-five percent of the respondeirfes^^^lt that they are 
more aware of norj^exist materiallHn their teaching areas 
since they attelmed the seminar. Teaching materials and/or 
"^^*hoi|s, to make them non- sexist, had been changed by 69 
percent of the respondents. Projects which emphasize women's 
contributions and changes in the woman's role in today's 
socifly have been performed by 31 percent of the respondents 
since their seminar participation. Finally, information 
gathere d at^ tjie seminar had been shared by 81 percent of the 
survey res^lffndents . It is clear that "The Woman in the Gray 
Flannel Fuit" seminar had an impact on participants in a 
number of areas. # 

• Chamber of Commerce/Career Education Department Seminars 

Another inservicing activity consisted of a series of 
seminars in career education, sponsored jointly by the Saint 
Paul Area Chamber of Commerce and the -Saint Paul Career 
Education Project. A follow-up survey was conducted among 
seminar participants . vThe survey form may be^found at the 
end of this report, a1$ Exhibit 6.2.4. Highlights of the 
survey results follow. On the following survey items, respec 
tive percentages of respondents who either agreed or strongly 
agreed are reported: _ 

The objectives of the seminar were 

clearly stated: 90% 

The siminar presentations contained 

new material: ' 921 

The seminar met my expectations: 851 

The seminar increased my knowledge of 

the St. Paul business community: 891 



There was a good balance of large and 

small group activity: 801 

There has been an increase in community 
involvement in my classroom as a result 
of the seminar: 34% 

28- , 



Students have benefitted from my 

atteiidance at a seminar: 661 

There should be mqye interaction between 

the schools and t Kb 'community: ■ 921; 

I would resommend attending a Career 

Education seminar to a colleague: 89% 

In addition; five other survey items were constructed to 
survey the utilization of career education materials and 
servicesi^ Results follow: * 

Are Career Education materials 

available in your school? Yes • 841 

No - 11* 

No Answer - 51 

Does your school have a Career - 

Resource Center? ' Yes - 841 

^ No - 42* 

No Answer - 7* 

Do students use the Career 

Resource Center? , Never. - 121 

. ;f. ^ Occasionally - 321 

C;.- li Frequently - 23% 

- No Answer - 33% 

Do you refer students to the . 
Career Resource Center? Never - 21lf; 

Occasionally - 2^1 
r Frequently - 16% 

No Answer - 34% 

^ Have you used the service (s) 

of the Cateer Education Center 
at Victoria? Yes - 38% 

; No - 59% 

^ * No Answer - 3% 

Utilization of Career Education Services 

Another survey which was administered among teachers 
and others was titled **Saint Paul Public School Career 
Education Resource Center Questionnaires : Career Education 
Services, Spring, 1976''. (See Exhibit 6.2.5)' The survey 
was designed to determine the amount of utilization of the 
various services, including materials, available from the 
Career Education Resource Center, Victoria School. Included 
were the following services: 
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Films J Filmstrips and 
Materials , Bibliograph 
Hand-Outs, Career Educ 
Board Ideas, Career Ed 
Career Education Staff 
Assistance in Planning 
Education Activities, 
Classroom Experiences, 
Activities, Simulation 
Fair, Classroom Presen 
and Career-Related Mat 



Cassettes , Cpmmercial 
ies. Career Education 
ation Newsletter, Bulletin 
ucation Related Units, 
Schobl Visitation, Staff 
and Implementing Career 
Resource People, Out-of- 

Interviews , Self -Awareness 
s/Role-Playing, Career 
tation. Seminar /Workshop, 
erials . 



Respondents were requested to indicate thei^r utilization of 
these services to provide an indication (on a scale of 1 to 
5) regarding how helpful the services were, -and whether 
or not they would like more help. In addition, respondents 
were asked to indicate how else the staff might be of asiss- 
tance. ' « 

The survey was administered among teachers, and other 
staff in both the elementary and secondary schools, with two 
major groups in mind, i.e. those who were being served 
directly during the year by the Career Education Resource 
Center Staff, and a sample of those not directly being served 
but for whom career education services could be available. 
Responses from the latter group, numbered only 5, Responses 
from the group being served directly, including staff in the 
Gemini Cluster, may b'e summarized as follows: . 



SERVICES: 



UTILIZED . im HELPFUL ^ 

(Percent of (Percent of Respondents) 



WOULD LIKE 
(^DRE) HELP 
(Pjercent of 



Films 

Filmstrips § Cassettes 

Conmercial Materials 
Posters 
Kits 

Bibiographies 

Career Education Hand- 
Outs (Activity Ideas) 



Bulletin Board Ideas 





1 


2 


3 


4' 


5 




20$ 




01 


0% 


7% 


20% 


13% 


7% 


41 




0 


0 


2 


24 


39' " 


7 


17 




2 


0 


9 


2 


19 


4 


24 




0 


0 


9 


9 


20 


4 


11 




0 


0 


' 4 


6 


15 


2 


28 


1 


2 


0 


11 


13 


22 


, 6 


er 11 




2 


7 


17 


2 


4 


4 


11 




0 


2 


4 


4 


6 


4^ 
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UTILIZED 
(Percent of 
v Respondents) 



' Care<ir Education 

Rqlated Units > 
SIU Paul teacher-dcWiel. 
I^iculiiil guides f 

Ca^mK Ed. Staff School 
visitation 

Staff Assistance in Plan- 



201 
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; WOULD LIKE 

IVW HELPFUL < (Mm) HELP 

(Percent of Respondents) (Percent of ■ 

Not Helpful Very Helpful Respondents 

1 , 2 — — T 



Ot 2« 6t 151 15t 



0^,JI...-2 7 41 



9% 



Career Ed Activities 


39 


0 


2 


0 


14 


- 43 


4 


Resource People 


44 


0 


0 


0 


11 


52 


11 


Out-cf-Classroora Experiences 50 


G 


0 


0 


11 


39 


6 


Interviews 


13 


0 


0 


6 


9 


11 


4 


Self Awareness Activities 


24 


0 


0 


7 


15 


15 


/ 0 


Simiilations/Role-Playing 


9 


0 


0 


5 


6 


13 \ 


2 


Career Fair 


13 


2 


2 


2 


5 


H ^ 


V 6 


Classroom Presentation 


17 


e 


-0 


5 


2 


24 


T * 


Seminar/Workshop 


28 


0 


0 


4 


13 


24 




Career-Related Materials 


22 • 


0 


2 


5 


18 


19 


7 



It is clear that, as Career Education Staff services become 
avilable to teachers in service, career 'teducation services 
are utilized and are deemed helpful. In addition, involve- 
ment with career education services results in the teachers 
seeing the need for additional assistance from the Career 
Education Resource Center Staff. 

Evaluation Activities at Teaching/Learning Sites 

A number of evaluation activities relating to Career 
Education have been carried on by teachers and others direttly 
involved at the learning sites. One ^teacher in particular who 
has been involved in career education activities and their 
evaluation is Ms. Sande Specie, a teacher in the C-Pod of the 
Career Development Center, at 360 Colborne. Ms. Speck has 
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obtained some interesting evaluation'^restil ts which are 
summarized in another document. The career education 
activities in the teaching/learning station have been aided 
by efforts and services of the Staff from the Career Edu- 
^cation Resource Center, 

• • Perceptions of Ihservice Staff and Others < 

EMS conducted a number of interviews with inservice 
• s taff involved in career education in elementary and secon- 
dary programs in the Saint Paul Public Schools, Major 
points expressed by various staff members may be summarized 
as ' follows : 

-Staff assistance from the Career Education Resource 
Center in planning and implementing career education 
is a vital ingredient relating to the process of 
infusing career^ education concepts into the ongoing 
curriculum. The careerseducation staff is the "cata- 
• lyst" in this procesjaj ^ 

- Time is a necessary ii^redient of career education 
planning, both for the teacher in service, as well 
as *the Districts* Career Education Resource Center 
staff. 

-The iJenefits available to students, staff, school 
and community ^ar surpass the relatively small invest 
ments of financial resources. Many "free" community 
resources are available, to cite only one area of 
opportunity. 

-The Saint Paul Schools will be wise to continue to 
support career education, a proposition which will 
have to deserve serious consideration in the year 
ahead, as the present project is completing its 
third and last year. There are feelings of support 
' for this proposition among those staff who have 

benefited from these Career^ Education Resource Center 
sfervices. 

4.2.4 Major Findings: Student Component ^ 

A number of Student Component Findings may be summar- 
ized for the Saint Paul Career Education Project, includ- 
ing results of the administration of the Career Maturity 
Inventory in Grades 9 and 11, as well as Scales of Self 
Acceptance, Social Maturity, School Affiliation and Self 
Security in Grades 3, 5 and Junior High. 
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Career Maturity Inventory Results 



The CMI (Career Maturity Inventory) was administered to 
Saint Paul students in grades 9 during 1973-74 ^nd 11 in 
1975-76. The CMI consists of a* Attitude Scale and a 
Competence Test with five subtests. The results, in terms 
of average raw score?, are shown in the following table, 
for grades 9 during tile 1973-74 year, and for grade 11 
durfng the 1975-76 year. Included among the 2,524 eleventh 
graders are students who were ninth graders during the 
1973-74 administration of" the CMI. 



SMm PAUL 
CAREER MATURITY INVENTORY 
• AVERAGE RAW SCORES 







« 




ATTITUDE 


KNOWING 


KNOWING 


CHOOSING 


LdOKING 


WHAT SHOULD 


YEAR 




GRADE 


N 


SCALE 


YOURSELF 


ABOUT JOBS 


A JOB 


AHEAD 


THEY DO 


1973- 


74 


9 


2916 


34.6 


12.5 


15.2 


12.6 


12.8 


9.9 


1975- 


76 


11 


2524 


35.7 


13.2 


15.9 


13.0 


12.9 


10.3 



Although there are no true national norms for the CMI, 
^ there are norms which generally are representative of stu- 
dents in broad sections of the country. In addition, the 
various subscores represent specific areas of career educa- 
tion program activity. Overall, Saint Paul students scored 
at or above other students whose raw scores contributed to 
the available norms. This indicates a strong base of career 
maturity attitudes and competi^ncies . 

Since the CMI provides a measurement of growth, the 
results show th^t gains have been significant when the 
ninth graders are compared with the eleventh -graders , 
Although *the student populations between the two school years 
may have differed somewhat, gains are shown in these total 
student populations over this two-year period. The Saint 
Paul student population appears to possess career maturity 
and a positive attitude toward the world of work. 

Elementary Survey Results 

As part of its district-wide testing program, Saint Paul 
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School^ have admiiristered a series of scales designed to4wea- 
sure thjB self-concept ot students in four major areas:- 
1) SeljM\tcelptance; 2) Social Maturity; 3) School Affiliation; 
and, 4) sVlf -Security. In Saint Paul, during the 1974*75 
year, 296 second grade st'u^Jents were tested. In 1975-76, 
545 grade 3 students were tested. The average scores (s.tai 
dard scores with a mean of 50 and a standard deviation o£r 
10), were as follows for these two yea^s: 

SCALE 1974-75 Grade 2< 1975-76 Grade.j 

Self -Acceptance 48.7"»^ -50.4 

Social Maturity 52.7 5a..-l !^ 

School^ff illation -46.6 SC^.S 1 

Self-Security 51.5 , 53^5 f 

Gains were shown in all areas except social maturit^; 

The intermediate-level version of this ^ame surUey re"^, 
ports the same fi^ur scales' as for the* primary level,v^lti5/*^ 
three additional scales: Teacher Affiliation, Peer Affiida* 
tion, and Social Confidence. During 1974-75, 262 stuflejit 
in grade 5 were tested, while in 1975-76, 578 students in 
grade 5 were tested. The average scores at the intermedial 
level were as/f ollows : 

Grade 5< 



SCALE 1974-75 1975-y<5 ' 

Self-Acceptance 51.0 53 J) 

* Self -Security ^50.4 52.5^ 

Social Maturity 51.8 51.1 

Social Confidence, 51.2 50*8 

School Affiliation 50.2 54; 7 ^ 

Teacher Affiliation 50.8 SZ^S ^ 

Peeiv Affiliation 50.J * SI. 




All scales are at or near national norms.. In suinm'axy'j||fo 
results of this testing have shown that elementary students 
in the Saint Paul Public Schools represent a student popu- 
lation which is close to the national norm in the measure- 
ment of various dimensions of self -concept, which is one of 
the major bases for career awareness. 



MINNEAPOLIS CAREER EDUCATION PROJECT 

4,3.1 Evaluation Objectives and Plan 

The evaluation objectives and plan discussed in Section 
4.1.1 was also applied to evaluation activitie? related to 
the Minneapolis Component of the project. During the 1974-75 
year (the first year "of the project^s operation) , student 
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outcomes baseline data were established in Minneapolis, _„ 
Data collection and analysis efforts were continued during 
the 1975-76 year, and staff baseline data collection, 
relating to the Curriculum Development/Inservice Component 
of the Evaluation Plan was established.' 

4.3.2 Major Findings: Management Component 

A number of major findings relating to the Management 
Component of the Minneapolis Career Education Project are 
found in Section 4.1.2. In addition, the following findings 
jnay be summarized for the Minneapolis Project: 

, • Accjags to Coromunity Resources 

Minneapolis Career Education Proj,ect continues to 
seek acceptance and support from key community groups, repre- 
senting commerce, labor and industry. 

• Staffing" Capabilities 

'The Minneapolis Career Education Project 'staff has 
brought good Capabilities in teaching and counseling as 
backgrounds for career education in Minneapolis Public Schools. 
The staff is particularly efficient in planning the work and 
in working the plan. The staff is assuredly small in numbers 
when compared with the number of staff found in many other 
metropolitan school districts. 

Evaluation Strengths 

The Minneapolis Career Education Project has shown a 
tendency to base its planning on the results of data 
collection and evaluation efforts. A number of evaluation 
efforts were already in progress when EMS arrived as the 
proj ect ' s third party evaluator . 

Servicing .Schools in the TVest Area 

The Minneapolis Career Education Project has developed 
a thrust in the West Area of Minneapolis Public Schools. 
Included have been a number of career education strategies, 
including the establishment of career education centers, in 
the various West Afea schools, serviced by the staff at the 
Career Education Center, Fulton School. With the allocation 
of a minimum of financial resources * being dedicated to the 
project, district-wide thrusts should be possible. The 
West Area development should serve as a model for additional' 
district- wide thrusts . 

4.3.3 Major Findings: Curriculum Development/Inservice 
Component 

* A number of Curriculum Development/Inservice Component 
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findings may be summariised for the Minneapolis Career Educa- 
tion Project, including those related to seminar/workshop 
evaluations, -Career Education Teacher Survey, and utilization 
of career education staff resources and materials. 

. Inservicing Activity Evaluation Results 

A number of Career Education Workshops were provided by 
the Career Education staff during the 1975-76 school year. 
In addition to the majority of the workshops, which were 
provided for elementary and secondary teachers, there was 
also a workshop for principals and for counselors. As part 
of the workshops, a pre and post- test on career education 
concepts was administered to the participants. Teachers 
responded to a twenty-item test (see Exhibit 6.3.3J, while 
counselors responded tp a twenty-six- item test. Pre and post 
test results, as shown in the following table, show an over- 
all pre-post gain of five test items for the elementary 
teachers, 3 items for the secondary teachers, and 2 items 
for the counselors. Elementary teachers included grades 
1^-6 and secondary teachers included grades 7-12, in all 
subject areas. 



MINNEAPOLIS CAREER EDUCATION 
FALL-SPRING. 1975-76 WORKSHOPS 

TEACHERS 
PRE-POST TEST RESULTS 
Cl"wenty-Item Test) 





PRE -TEST 


POST-TEST 


GAIN 


GROUP (N) 


MEAN 


MEAN 


' MEAN 


Elementacry (19) 


14 


18 . 


4 


Elementary (19) 


13 


17 


4 


Elementary (20) 


13 


17 


4 






19 




Elementary (11) 


13 


6 


Elanentary (11)* 


13 


19 


6 


ELEMENTARY TOTALS (80) 


13 


18 


5 


Secondary (22) 


13 


17 


4 


Secondary (29) 


15 


17 • 


2 


Secondary (16) 


15 


18 


3 


SECONDARY TOTALS (67) 


14 


17 


3 
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OOUNSELORS 



PRE- POST 'TE^ RESULTS 
(Twenty- Six Item Test) 



(N) 


PRE-TEST 


POST-TEST 


. GAIN 


MEAN 


. * MEAN 


^ MEAN 










15 


15 















In addition, a Workshop Evaluation Questionnaire w4s adminis- 
tered at the end of each workshop. The four major items of 
the questionnaire follow, along with responses roost frequently 
given by the teachers/counselors/administrators in attendance 
at the workshop: 

1. What did you find most beneficial ? ^ 

• Presentations 

• Resource Information/Materials 

• NSP Trip 

• Ideas/New Concepts/Sifg^gestions 

2. What did you find least be neficial? 
— ^ ^^^^ 

• Presentations 

• Films/Games too Long ^ 

• Special Education Session 

• Small Group Sessions ^ 



3. 



What other topics would you have liked covered in 
this workshop? ^ " 



>rkshop 

• , A 

• Concrete Ideas: Initiaring Career Program 

• Presentations by OccupationaJ>sjClusters 

• Time wtth Materials/Bibliograpliies/Ideas 

• Examples of Units Taught in Elementary 

• Changing Jobs in Twin Cities 

• Career Motivation/Decision-Making 

• How to Set Up a Resource Center * 

4. Did you find anything that you felt shoul 
have been included ? ' 

• Last Sessions Could be Shortened 

• Shorter Spoeclies 
, * Discussions bn Racism/Sexism 
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The Career Education Staff has utilized the workshop evalua- 
tion results , after each woflishdp , in planning each subsfiri> 
quent workshop, 

. Career Education Teacher Survey 

One of the major obiectives of the 1975-76 evaluation 
project has been to establish baseline-data on teachers, as 
background for measuring teacher inVjplvement in career 
education activities, as well as teacher opinions and other 
attitudes relating to career education. Exhib^.t 6.3.4 in 
the Appendix is the survey form utilized. A sample of ele- 
mentary and secondary teachers w^re surveyed. Results of tho 
survey for elementary and secondary (combined) teachers, 
corresponding to the two majof areas surveyed (i.e. Teacher 
Activities and Teacher Opinions) by number of responses, are 
found on the following pages. ^ 

Survey results relating to Teacher Activities are sum- 
marized by frequency of use, as well as in comparison to the 
previous school year. The item "integration of career 
education into my curriculum" was reported "nearly every day" 
by 21 respondents and "about once a week" by 19 respondents. 
Forty respondents reported' "more" (6f this same activity) 
in comparison with the previous school year. Likewise, 
"career related units" . reported by 11 respondents 

"nearly every day"^ and 57 respondents reported more of this 
same activity than during the previous school year. "Field 
trips" were reported less frequently, perhaps because of a 
budget cut which allowed fewer to happen. 

In the area of Teacher Opinions, the following items 
received the highest "strongly agree (SA)" responses: 

- ' The career resource staff are open and willing to 
help me. (54) 

^ - A sound career education program should emphasize 
the use o£ communi^ resources outside the class-* 
room. (45) 

The career education program should involve all 
students and all teachers. (42) jtfjk 

In addition, .virtually all respondents (f^out of 81) 
felt they understand the term **Career Education". Likewise, 
nearly all (76 out of 81) agreed that they know who to go 
to for assistance in planning and implementing career edu- 
cation activities. The reader can gauge the growth in career 
education activity participation since last year. Results 
of this survey will be particularly useful when comparisons 
cau be made with 1976t77 survey results a year hence. 




CAREER H3UCATI0N TFAQIER SURVEY 
TEAQIER ACrlVIHES 
Elementaiy and Secondary (Combined) Results 

■ r. - - - 



Frequency of Use 



Canpared To 
I Previous School Year 



1) Integration of Cfgreer 
Education into my 

.curriculum 

2) Use of Career Related 
Activities as: 

films, filmstrips or multi- 
media kits 

field trips 

resource people ' 

group discussion on careers 
or job opportunities 

career related units 

worker interviews 

career related displays or 
bulletin boards 

3) Are you involved in self- 
awareness activities with 
your students such as: 
values clarification, DUSO, 
or SRA, interest inventories, 
self- awareness units, 

role playing 

4) Help from or joint planning 
with the cardter education . 
staff 

5) Use of library or career 
center, career related 
materials 



21 



•1 
0 
2 

6 

11 
1 



19 



10 
S 



22 
4 

3 



13 



14 



19 
9 
7 

14 
16 
8 

10 



12 



10 



33 
25 
31 

21 

19 
27 



17 



21 



33 



29 



3 
10 
10 

3 
7 
IS 

10 



10 



2 
9 
7 

3 

i 

4 



18 



29 


27 


25 


10 


22 


21 


14 


40 


20 


57 


13 


15 



18 



28 



14 



16 
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GAMER EDUCATION TEAOER SURVKV, 1975-76 • |: 

TEACHER OPINIONS ^ 
Elcsmentai^y and Secondary (Contblneaj Results 

Using the following scale, pleas© record your opinions by circling the nunber corresponding 
to your answer : / * 

^ 1 - if you strongly agree with the statement 

* 2 - if you ggree with the statement in general ^ 

3 - if you are uncertain about your feelings 

4 " if you disagree with the statement 

5 - if you strongly disagree with the statement 



- The goals of the careeV education program in the Minneapolis 
schools are clear to me ^ 

^ The career education program should involve all students 
and all teachers 

- A sound career education program should emphasize the use 
of community resources outside the classroom 

' • * 

- A career education program should enable students to 
explore preferences to a depth desired 

- My role as a teacher is that of a facilitator of 
learning rather than an information giver 

- The interviewing of adults by students is a vital part 
of the career education program 

- The career resource staff and office are open and willing 
^o help me 

- I feel that career education activities have helped the 
majority of my students^ 

a) become active ^rather than. passive Reamers 

b) increase their understanding of laajQf occupational 
fields . M . 

c) stimulate thought about career chaiCes that are 
realistic 

d) view education as a continuous process 

*e) relate school jubjects to knowledge and skills 
needed in the wrld of work 

f ) clarify misconceptions and stereotypes about certain 
occupations 

g) understand the iii5>ortance of the 3R's in both school 
and work 



C A 


A 


■f 

1 f 

U 


D 


SD 


27 


46 


5 




1 


42 


31 


5 


2 




45 


30 


3 


1 


- • 


28 


44 


5 


1 


- 


24 


37 


11 


6 




18 


39 , 


21 






54 


24 


1 




• 


10 


38 


20 


2 




12 


48 


8 


2 




14 


41 


15 


1 




15 


41 


15 


1 




15 


40 


14 


1 




14- 


39 


15 






14 


35 


20 
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CAREER EDUCATION TEACHER SURVEY, 1975-76 . 
TEACHER OPINIONS 

Elanentary and Secondary (Conbined) Results 
(cont,) 4 



- Do you feel you understajid the terra "Career Education?' 
Yes 78 No - Not Sure 3 



• Would you rather see career education taught as a separate element o£ the curriculum 
instead of trying to integrate it into other subject areas? 

4 

: Yes 9 No 60 hfot Sure 11 



- Do.'you know who to go to for assistance in planninjg and iii^|gnenting' career 
education activities^? 

Yes 76 No - Not Sure 5 




- Have you utilized the materials and/or concepts developed during the workshops? 



Yes M No 5 Not Sure 8 
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Career Education Staff and Resource Center Activities 



Further indications of career education staff efforts 
and utilization of career education materials may be found 
in documentation available at the Fulton School Office. This 
documentation includes logs which are maintained weekly and 
relate to both staff activities and check-out of materials. 
Examples of the forms used in this logging procedure may be 
found in Exhibits 6.3.5 and 6.3.6, in the Appendix filed 
supplement to this report. Summaries of the data from staff 
log sheets have been provided in each of the quarterly re- * 
ports filed by the Minneapolis Career Education Project Ad- 
ministrator. An examination of the career education mater- 
ials log records by EMS has shown an active and a relatively 
high and frequent utilization of career education materials. 

Further explanation of materials usage from the Fulton 
Career Resource Center should be made. The Elementary Re- 
source Office materials are sent directly to teachers, ' Some 
of the secondary resdurces'' are lent from the Fulton Career 
Resource Center,, but generally the' Minneapolis Career Edu- 
cation Proiect recommends purchase for the individual 
(secondary; school career centers. . 

4.3.4 Major Findings: Student Component Hi 

A number of Student Component Findings may be reported 
for the Minneapolis Career Education ^Project, including re- 
sults of the administration of the Career Maturity Inventory 
in secondary schools and of the Career Education Student Sur- 
vey in the (elementary schdols. 

Career Maturity Inventory Results 

The Career Maturity l^nventory (CMI) consists of an 
Attitude Scale and a competence test, wi.th five subtest^. 

During the 1974-75 year, 63 Minneapolis eighth graders 
and 62 tenth graders responded to the CMI Attitude Scale and 
the Competence Subtest, Knowing About Jobs. During the 1975- 
76 year, 227 eleventh graders, in two Minneapolis high schools, 
and 128 ninth graders in a junior high school, responded to 
the CMI Attitude Scale and four of the five sub-scales on the 
Competence Test. The results, in terms of average raw 
scores, are shown in the following tab le , for grades eight 
and ten during the 1974-75 year, ^nd for grades 9 and 11 
during the 1975-76 year. ' 
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Minneapolis Career Maturity Inventory 
Average Raw Scores 



Year 




Grade 


N 


Scale 


ivnowiiig 
Yourself 


Miowmg 
About Jobs 


Choosing 
A job 


Looking 
Ahead 


What Should 
They Do? 


1974- 


■75 


8 


63 


32.7 




14.7 • 








1974- 


•75 


10 


62 


34.8 




15.8 








1975- 


■76 


9 


128 


33.1 , 


12.2 


13.5 


11.4 


11.6 




1975- 


■76 


11 


227 


36.0 


13.6 


16.8 


13.1 


13.5 





Individual pupil reports and school summaries have been i5ro- 
vided to the Minneapolis Schools for the CMI results this year. 
Although there are no true national norms for the CMI, there 
are norms which generally are representative of students in 
broad sections of -the country. Further, the' various subscores 
represent specific areas of Career Education program activity.. 
Overall, Minneapolis students scored at or above other students 
•whose raw scores contributed to' the available norms. This 
indicates a strong base of career maturity, attitude and com- 
petencies. The eleventh grade students, (whose high schools 
are in the West Area of Minneapolis Schools, ie. the project 
target area) scored particularly high in comparison with their 
grade norms. 

Since the CMI provides a measurement of growth, the re- 
sults show that gains have been significant when the (1974-75) 
eight and tenth graders are compared with the (1975-76) ninth 
and Seventh graders. Although the student populations between 
the two school years may have differed somewhat, gains are 
'shown in these total student populations over this two-year 
period. The Minneapolis student population appears to possess 
career maturity and a positive attitude toward the world of 
work. 

During the fall trimester, 1975, a ninth grade group 
in the West Area was pre-and post-tested at the beginning 
and end of a unit taught in Career Education, on the Attitude 
Scale and four sub-tests of the Competence Test, i.e.. 
Knowing Yourself, Knowing About Jobs, Choosing a Job, and 
Looking Ahead/^ This group (School A, Pre-and Post-Test) 
are compared with a group of 128 ninth graders, in another 
area of the city, who responded to the CMI later in the 
1975-76 school yejar (School B) . Results follow. 
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MINNEAPOLIS CAREER MATURITY INVENTORY 
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A (Pre-Test) 


109 


35.2 


13.8 


14.9 


13.4 


12.8 


A (Post-Test) 


109 


38.0 


14.3 


16.4 


14.5 


14.2 
















B ^(Qne test only) 


128; 


33.1 


12.2 


13.5 


11.4 


' 11.6r 



^ — - : * -' 



Raw scores for School A ninth grade students whp were 
.exposed tp a concentrated career education unit were 
significantly higher on the Attitude Scale and all four of 
the Competence Sub-scales, in comparison with raw scores for 
students in School, B, with no particular career education 
exposure, . , * 

Elementary Survey Results 

" — V 

Through the joint efforts of EMS and the Minneapolis 
Career Education Project Staff, a Career, Education Student 
Survey, Spring, 1976 was developed. fSee Exhibit 6,3.7 in 
the Appendix). This survey was administered to third and 
fifth gr^^de students in elementary schools, both to classes 
whose teacher had attended a Career Education workshop arid 
to classes whose teacher had not participated. The follow- 
through responses to the survey were as follows: 

With teachers attending a workshop : 

Third graders = 94 l^ifth graders = 104 Total. = 198 

With teachers not attending a workshop : 

Third graders ^ 107 Fifth graders =89 Total = 196 

The comparative responses, expressed as percentages, 
, are summarized .by survey item in the next pages of this 
section. • 

The summary provides a listing of each of the fourteen 
survey items, and a distribution of responses by grade and 
overall^for the two groups of students, i.e,. Group A: those 
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whose teacher attended a Career Education 4Vorkshop and 
Group B: those whose teacher did not attend. In addition, 
for each survey item, a mean response (1 « agree, 5 = dis- 
agree) is also provided. .Those students who responded to 
an item with either "1" or "2"* are counted as agreeing with 
the istatement, in the discussion which follows. 

Ninety- two and 94 percent of Groups A and B, respec- 
tively, agreed with the statement, "Mathematics is important 
to people who work". Forty-six percent of Group A, and 29 
percent of Group B agfteed with the statement^ "I would like 
to ^row up and have the same type of job as my mother or 
feather". In response to the statement, "I like to visit 
businesses and workers outside of school", 77 percent of 
Group A and 81 percent of Group B agreed • In response to 
the statement, "I do some things well that would help me on 
the jofe", 86 percent of Group A and 82 percent of Group B 
agreed. Other slight differences in agreeing responses are 
noted for the remainder of the items in the survey. Many 
of the third and fifth-grade classes with teachers not 
attending were well advanced in career educ^;^ion, as is 
reflected in the responses of Group B. - ^i^'^^. 

Minneapolis results on this questiqnnaM^ were also ^ 
compared, for five of the survey items, with a rtational 
sample of pupils in Grades 4-6, utilized in a U.S. Office"'*' 
of Education study during 1972-73. This comparison is shown 
in the following table. 

It is apparent that Minneapolis responses were gener- 
ally more positive on items 1, 4, 5, and 8 than those in 
the national sample. It is also apparent that attitudes 
of the Minneapolis third and fifth graders surveyed were^ 
generally positive, as shown by high percentages, of agree 
ment with survey items. 

COMPARISON OF MINNEAPOLIS 
AND NATIONAL SAMPLE: 



ATTITUDES TOWARD CAREER EDUCATION 





NATIONAL SAMPLE 


MINNEAPOLIS 


SURVEY lim NUMBER AND STAT0TO' ^ 


Percent 


Percent 




Agreeing 


Agreeing 



Group A Group B 



1. Mathematics is important to people 
who work 



941 



2. I would like to see films about 
how things are made 



78 



68 



79 



45 



COMPARISON OF MINNEAPOLIS 
AND NATIONAL SAMPLE: 

ATTITUDES TOWARD^ GfiSte EDUCATION 





NATIONAL SAMl>Lfe 


MINNEAPOLIS 


SURVEY ITEM NUMBER AND STATEMENT 


Percent 


Percent 




Agreeing 


Agreeing 



Group A Group B 

4, Students should be taught about . 

jobs in school 72% 73% 82% 

5. School should teach me things 

I can use on a job 66 75 79 

8. I am too young to think about 

wjiat I want to do \Axen I grow up 22 30 16 



CAREER EDUCATION STUD1-NT SURVEY, SPRING 1976 
MINNEAPOLIS SQKXIIS 
SAMPLE OF THIRD AND FIFTH GRADES 



Survey Item 



Teacher Attending 
. ' Workshop (A) 
Grade ~ 
3 5 / Overall 

(N=94) (N=1D.4) (N=198) 



Teacher Not Attending 
Workshop QB) 



Grade 
3 

(N=107) 



5 • 
(N=89) 



Overall 
(N=196) 



1 Mathanatics is important to people 
who ■> work 



2. 



1' = Agree 


67% 


70% 


69% 


72% 


61% 


67% 


2' • 


23 


23 


23 


18 


38 


27 


3' ■ , 


9 




7 


5 


1 


3 


4 . 












S = Disagree 


1 


/ 

/.I 


1 ■ 


5 




3 


Mean 


1.45 


/1.39 


1.42 


1.46 


1.41 


1.44 



I would like to see films about 
hovr tl|wigs are made 
v 1 = Agree 

2 . 

• 3 . . 
.4 

* 5 = Disagree 
Mean ' 




39 


44^ 


54 


37 


47 


21 


24 


24 


42 


32 


25 


■ . 20. 


17 


16 


16 


8 


■ 'O S . 




1 


0 


7 


' 7 


5 


4 


5 


2.23 


2.06 


. 1.77 


1.95 


1.85 



r would like to grow up and have 
the same type of job as my mother 
or fattier 



1 = Agree ' 

2 ' 
3 

^4 

5 = Disagree 
Mean 



,/ 



Students. should be taught al^ut 
jobs in school , / 



1 = Agree 

2 

3 

4 \ 

5 = Disagree 
Mean 



/ 



/ 



School shofcild teach me things I 
can use on a job / 

, 1 = Agree 

. 2 



3 
4 

5 = Disagree 
Mean • 



/ 
/ 



28 


26 


27 


23 


10 


17 


23 


16 


19 


10 


. 15 


12 


' 19 


14 


17 


29 


31 


30 


6 


12 


9" 


8 


14 


11 


24 


32 


28 


30 


30 


30 


2,78 


3.08 


2.94 


' 3.14. 


3.36 


3.24 

o 






/ 

■i 




















43 


48 


45 


56 


42 


49 


24 


30 


28 


16 


32 


23 


19 


17 


18 


16 


20 


18 


44 


4 


4 


' 5 


3 


4 


-10 


1 




7 ■ 


3 


6 


2.14 


1.80 • 




1.92 


1.96 


1h.94 


50 


58 


53 


53 


50 


51 


20 


23 


22 


20 


38 


28 


20 


12 


16 


9 


6 


8 


4 


4 


4 


7 


3 


5 


6 


3 


5 


11 


3 


8 


1.99 


1.70 


1.84 


2.04 


1.70 


1.89 
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CAREER EDUCATION STUDENT SURVEY, SPRING 1976 
MINNEAPOLIS SQIOOLS 
, SAMPLE OF THIRD AND FIFW GRADES 



Survey Item 



Teacher Attending 
Workshop (A)- 
Grade 



Teacher Not Attending 
Workshop (B) 



Grade 



3 

(N=94) 



5 

(N=104) 



Overall 3 
(N=198) ^(N=107) 



5 , 
(N=89) 



Overall 
(N=196) 



6. My job is being a student 



9. 



10. 



1 = Agree 


65% 


45% 


55% 


75% 


40% 


59% 


2 


14 


22 


18 


7 


20 • 


13 


3 . 


10 


18 


^^14 


7 


22 


14 


4 


2 


3 


3 


4 


8 


6 


5 = Disagree 


9 


12 


10 


7 


8 


8 


Mean 


1.75 


2.15 


1.96, , 


. 1.63 


2.21 


1.89 


like myself 














1 = Agree 


77 


83 


80 


80 


83 


82 


2 


12 


9 


10 




15 


10 


3 


6 


8 


8 


7 




4 


4 \ . 


1 








1 




5 = DiWgree 


4 




2 


6 


1 


4 


Mean 


1.45 


1.26 


1.35 


1.47 


1.23 


1.36 



8, I am too young to think about 
what I want to do when I grow 
up 



1 = Agree 


23 


10 


17 




16 


2 


9 


2 


10 


17 


13 




4 


10 


7 


3 


14 


9 


11 




6 


8 


7 


4 


6 


6 


6 




8 


76 


16 


5 = Disagree 


47 


58 


53 




66 


54 


61 


Mean 


3.44 


3.85 


3.65" 


. 4, 


.05 


4.23 


4.13 


I get along well with my class 














mates 
















1 = Agree 


42 


47 


45 




50 


33 


43 


2 


27 


25 


26 




26 


47 


35 


3- 


24 


14 


18 




17 


.17 


17 


4 , 


4 


6 


5 


J 


1 


3 


2 


5 = Disagree 


3 


8 


6 


6 




3 


Mean 


2.00 


2.04 


2.02 


1. 


86 


1.92 


1.89 


I feel good about the decisions 














I make in school 
















1 = Agree 


40 


44 


41 




54 


42 


48 


2 


28 


27 


27 




24 


39 


31 


3 


26 


25 


26 




17 


16., 


16 


4 


3 


2 


3 






3 


2 


. 5 = Disagree 


3 


2 


3 




5 




3 


Mean 


2.04 


1.92 


1.92 


1. 


78 


1.81 


1.79 
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CAREER EDUCATION STUDENT SURVEY, SPRING 1976 
MINNEAPOIJS SaiOOLS " 
SAMPLE OF THIRD AND FIFTH GRADES 



Survey/ Iteril 



ieacher Attending 
. Workshop (A) 
Grade 

3 5 Overall 

(N=94) (N=104) (N=198) 



ieacher Not Attending 

Workshop (B) 
Grade ~ 
3 5 
(N=107) (N=89) 



Overall 
(N=196) 





13. 



14. 



11 enjoy intervieidmg workers in 
our classroom 



1 = Agree 


■ 53% 


26% 


39% 


52% 


13% 


34? 


2 


15 


17 


16 


14 


22 




3 


18 


27 


23 


19 
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^ 30 


4 


. 4 


11 


8 


8 


6 


7 


5 = Disagree 


9 


19 


14 


7 


16 


11 


Mean 


2.02 


2.81 


2. 43 


2.02 


2.91 


2.43 


I like to visit businesses and 














workers outside of school 














1 =» Agree 


70 


50 


59 


56 


46 


S#' 


2 # 


15 


20 


18 


23 


39 


29 


3 


8 


18 


13 


8 


12 


10 


4 . 


3 


. 4 


4 


5 


3 


4 


5 = Disagree 


4 


'8 


6 


8 


1 


5 


Mean 


•1.57 


1.99 


1.79 


1.83 


1.77 


1.80 


I do sane things well that 














would help me on a job 














1 = Agree 


64 


49 


56 


58 


63 


60 


2 


27 


33 


30 


22 


23 


22 


3 ■ 


8 


12 


10 


11 


10 


11 


4 


1 


2 


2 ^ 


1 


3 


2 


5 = Disagree 




4 


2 


8 


1 


5 


Mean 


1.47 


1.78 


1.63 


1.82 


1.58 


1.71 


I would like to work at a job 














when I finish school 














1 = Agree \. 


^70 


79 


75 


76 


89 


82 


2 


12 


12 


12 


7 


6 


6 


3 


14 


7 


10 


11 


4 


8 


4 








1 




1 


5 = Disagree 


4 


2 


3 


5 


1 


3 


Mean 


1.57 


1.34 


1.45 


1.51 


1.20 


1.37 
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CONCLUSIONS AND RECOMMENDATIONS 



Results and findings of the Third-Party Evaluation of the 
Saint Paul-Minneapolis Career Education Project during the 1975- 
76 year, have been reported in the foregoing sections of this 
Final Report. This section of the Report discusses conclusions 
and presents recoramendatiohs relating to the Project. In the 
first sub-section (5. 1) , the (combined) Saint Paul -Minneapolis 
Project is first discussed, including comments which relate to 
both of the Project Sites, at Saint Paul and Minneapolis. The 
last two sections (5.2 and 5.3) serve to comment on the Saint 
Paul and Minneapolis project sites, respectively. 



5.1 SAINT PAUL-MINNEAPOLIS CAREER EDUCATION PROJECT 

1) A significant amount of community involvement has been ob- 
served at both Saint Paul and Minneapolis ,^ as well as a 
willingness' on the part of the Twin Cities community to be 
involved in the future, including the 1976-77 year. 

2) The target groups, including students , as"* ^ell. as school 
staff and community organizations,, ^xe hei^g spryi^d by 
both sites. Target groups being served 'Vary fr^^ 

Paul to Minneapolis, based upon student characteristic^ 
and community backgSrounds. 

3) Eiach of the two project sites, and the (combined) Saint 
Paul -Minneapolis Project, show evidences of management 
systems operation, with project monitoring being provided 
by the career education staffs at each site, by DHEW/USOE 
project liaison. Region V office, Chicago, and by the Third 
Party Evaluator. 

4) Growth in staff development at both sites has been evident. 
A considerable number of inservice activities have been 
observed and continue to be planned. 



5) The project, including operations at both Saint Paul and ^• 
Minneapolis, shows evidence of cost effectiveness. The ^ 
project, operatinjg in Minnesota's two largest school dis- 
tricts, has provided a vehicle for optimal return of 
Federal as well as local dollars. The use of personnel 
and materials, as well as the projects* spending plan, 

are on schedule at this stage of its development. 

6) A significant amount of planning and articulation has 
occurred during the 1975-76 project year, ie. between two 
cooperating school districts, with the Minnesota Department 
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of Education, with DHEW/IISOE and with the Third-Party 
Eyaluator. Career Education is providing a ^'common 
denominator" of interest- bet|pen elementary and secondary 
education in both school districts, 

7) A number and variety of career education activities are 
taking place, both in the school and ''community settings, 
at both Saint Paul and Minneapolis. 

8) Activities at both project sites are attracting state- 
wide and national attention. Numerous inquiries from 

other school districts and projects concerning career ^ 
. education activities and products are being evidenced 
both within Minnesota and elsewhere • 

9) There is evidence of the use of career education materials 
and procediites in other areas of the school curriculum, at 
both Saint Paul and Minneapolis. 

10) The school administrations at the two project siteS^ are 
showing support and are seeking to promote infusion of 

' career education into the general curriculum. Particular 
support for career education has come from Research and 
Evaluation in both Saint Paul and Minneapolis Schools. 

11) Both school districts have sought to be helpf uJi&^jg^e 
private and parochial schools in the Tv?in Cit ieJ^HBtefplitaTi 
area . ' 

12) At both Saint Paul ahd Mihneapol is , more time is needed for 
career ejducation planning and inservicing activities. Class- 
room teachers are the key -[Jersonnel for the infusion of 
career concepts with the ongoi^ curriculum of the schools. 
They need encouragement in th^se areas from their principals 
and other district administrations. 

13) Students at both project sites are bejyig exposed to a variety 
of experiences, both within the school and in the immediate 
community. 

14) At both sites, the school-community relationships which' 
are developing can have las ting impacts on the schools 
and the communities in the years ahead, with continuing 
support. ■ 

15) As the third and final year of the Saint Paul-Minneapolis 
Career Education Project is approaching, there is a real 
need for the districts to be forming goals and objectives 
relating to the continuation of career educ"ation thrusts 
beyond the June 30, 1^7 termination of the Project. It 
is ^recommended that Saint Paul and Minneapolis Schools, in 
conjunction with the Minnesota Department of Education^ 

' write a proposal to -Implement , Demonstrate and Evaluate an 
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Experience-Based Career Education Program (EBCE) which 
has been developed and tested at one or more o£ the four 
^ s Educational Regional Laboratories wl]ich have developed 

' . ; EBCE Programs under the leadership of DHEW/USOE. 

. * 16) Student outcome measures in career education have served 
;^ t to document growth in^ career awareness, exploration, career 

maturity, and^^g^^^ive at titude toward the world of work. 

17) It has been a pleasure for EWS to have been involved 

with fhe projecJt personnel in Saint Paul, Minneapolis, and 
USOE Region V (/ffice, Chicago. In anticipating the 1976- 
77 operation of the Project as a Third-Party Evaluator, 
it will help a great deal to be on contract earlier dur-- 
ing the coming year, so that evaluation planning for the 
1976-77 year can commence no later than September, 1976. 



endell 




18) Oliver Wendell H*lmes is quoted as having said. 



"There is no force that can withstand a good 
idea whose tim^ has come of age" 

It is our hope that this concept will fully apply to ^on-. 
tinued Career education thrusts in both Saint Paul 'and 
Minneapolis Schools, during the immediate years aheacj. 

5.2 SAINT PAUL CAREER EDUCATION PROJECT 

1) The Saint Paul Community provides an excellent cross 

section of the nation for demonstrating career education 
programs. There is an exemplary commitment to working, 
with Saint Paul Schools, in educational programs, includ- 
ing career education, on the part of the Saint Paul Area 
Chamber of Commerce. 

^ 2) The school principals and career center coordinators are 
key readership people beyond the Career Education staff 
themselves. It is hoped that .they will continue to help 
see that career education concept infusion takes place, 
particularly sinci not enough time is ever available to 
a^bcomplish all things. 

3) It is important that the career education project staffs 
and advisory committee continue to seek support from the 
Saint Paul Schools. This period of time marks the com- 

^, pletipn of two-thirds of the time span for the project - 
/ staff to review and update goals and objectives with the 

school administration/board, with the Minnesota Department 
of Education, and with the U.S. Office of Education. 

4) .Utilization of Career Education staff services and materials 

have tendecj tq .increase/as the career education staff have 
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had an opportunity to reach and inspire additional teachers 
and other personnel in Saint Paul Schools. 



3 MINNEAPOLIS CAREER EDUCATION PROJECT 

1) A significant amount of technical assistance has been ob- 
served as the Minneapolis Project has planned and imple- 
mented career education in one C^^irgeted) area of Minneapoli 
Schools. The West Area development during the past two 
years should serve as a model for district-wide career 
education thrusts in the years ahead, 

2) Teacher background and opinions, surveyed in detail, show 
growth in knowledge, enthusiasm and involvement in career 
education projects being implero.ented in Minneapolis. 

3) It will be helpful for the Minneapolis Career Education 
Project Staff to review and update project goals and plans, 
as the third year of the project is approached. Thft place 
of Career Education in the total. school system should also 
continue to be discussed- and defined. 

A) It would be especially helpful to add^ one additional major 
staff member to the Minneapolis Career Education Staff. 
This would alTow the Project Administrator, who must utilize 
a portion of his time in Secondary career education thrusts^ 
to devote more overall attention to the development and 
leadership toward district-wide strategies, Decisions on 
administrative structures, local fuiiding, and direction 
for Career Education must be made. 
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VI. EXHIBITS ' 

6.1 Saint Paul-Mingeapolis Career Education Project 

6. 1.1 Evaluation Plan Summary Chart 

6.1.2 Agenda # 

6.2 Saint Paul Career Education Project 

6. '2,1 Purposes ahd Goals of the Saint Paul Career Education 
Project / 

6.2.2 Saint Paul Evaluation Needs ^ 

6.2.3 "The Woman in the Gray Flannel Suit" Follow-up 
Questionnaire 

6.2.4 Evaluation of Chamber of Commerce/Career Education 
Department Seminars 

,6.2.5 Saint Paul Public Schools Career Education Resource 
Center Questionnaire 

6^3 Minneapolis Career Edu'cation Project . , 

6 •3.1 Purposes and Goals bf Minneapolis Career Education 
Project 

6.3.2 Minneapolis Evaluation Needs 

6.3.3 Career Development Test 

6.3.4 Career Education Teacher Survey, 1975 «76 

6.3.5 Career Education Project • Weekly Report 

% • ' 6.3.6 Check Out Sheet . ^ . 

6.3.7 Career Education Student Survey, Spring, 1976^ 
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" B{HIIITT^:Tri " 
EVALUATION PLAN SIJWARY CHART 



PROJECT: Saint-Paul-MinHapolis, Career Education Project 
EVALUATOR: ' Educational Management Services, Inc. 



EVALUATION CCMPONENT/ACTIVm 



2. CURRICULUM QE VELOPMBJT/ 

2.1 Dimensionalize Curriculum/ 
Inservice Objectives 

2.2 Develop Instrumentation 



2.3 Assess Attainment of 
Objectives 



3 . • STODEOT CCMPGNEOT 



BASELINE DATA 



INSTRUMEOTATION 



1. MANAGEMENT COMPONENT 

1.1 Dimensionalize Goals/ 
Objectives 

1.2 Monitor Project Plan 



DATA COLLECTION 
RESPONSIBILm 



ANALYTICAL 
TECHNIQUE 



Project Proposal/ 
Reports/Staff - 

Project Plan/ 
Evaluation Plan 



Project Proposal/ 
Reports/Staff 

Project Proposal/ 
Staff/First Year 
Results 



Documentation 
Available 



Documentation 
Available 

To Be Developed 



Curriculum Development/ Field Research 
Inservice Instrumenta- Questionnaire 
tion ^ 



Evaluator/Project Summary § 
Staff Documentatio- 



Evaluator 



Evaluator/ 
Project Staff 

Evaluator/ 
Project Staff 



Evaluator 



Summary § 
Documentatior 



I 



Statistical 
Summaries ^ 
I^ofiles 



^ 3.1 Clarify Objectives/ 
Identify Measures 



3.2 Administer Inventory and 
Survey Measurements 



Project Proposal/ . 
Reports/Project Staff 



First Year Results 
3.3 Score/Analyze Survey Data Instrumentation Results 



To Be Confirmed 



Evaluator 



IlMiendKdt^r 



Evaluator/Project Pre-Post Com 
Staff parative ^ 

Analyses . ^ 



Evaluator 



Summary § 
Documentatior 
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PAGE 56 CONSISTING OF A MEETING AGENDA WAS NOT REPRODUCIBLE 
AND WAS REMOVED FROM THIS DOCUMENT PRIOR TO ITS BEING SUBMITTED 
TO THE ERIC DOCUMENT REPRODUCTION SERVICE. 
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EXHIBIT 6.2.1 

' " PURPOSES AND GOALS OP 

THE SAINT PAUL CAREER EDUCATION PROJECT 

Summary portions of the Saint Paul project overviews, including 
purposes and goals, pertaining to the second year's evaluation, are 
presented in this Exhibit. , * 
SAINT PAUL PURPOSES A'ND GOALS 
Purposes 

Saint Paul has entered Phase IV, of its career education 
program and this involves specialized staff ing , teacher pre- 
pared instruct ional modules and expansion of career education 
resource centers, c 

Phase I included appointment of a Director of Career Education 
^nd two consultants, - one elementary and one secondary. The 
staff then developed and presented a .Five Year Plan li^j the 
Board and State. The staff then developed an audio-visual 
presentation on Career Education fbr districtwide utilization. 
^ Citywide woi;kshops were then instiWted cooperatively with the 
University of Minnesota. ^'^^ — ^ 

Phase II marked the formulation and functioning of the Career 
Education Advisory Council. During this phase, the Saint Paul 
Area Cha^pber of Commerce established a series of seminars 
during the summer with Saint Paul Schools. Career Education 
councils were formed in some of the secondary schools. 

Phase III marked the start of a series of television programs, 
20 minutes in length, 30 in number, beamed at careers for ele-' 
mentary children. We will continue to plan, develop and im- 
plement in-service training teams to conduct building workshops 
Continued implementation of Career Education workshops for 
public and parochial teachers, counselors and administrators, . 
will be a priority item in Saint Paul. 

Major Goals for Saint Paul in Three Years 

Teachers will begin to write instructional units infused 
with career education. 

This will he done either by providing a substitute or al- 
lowing the teachers to work during off hours or during 
vacation time. The career education staff will work closely 
with these teachers tp insure that the units reflect com- 
munity resources, media (slides, cassettes, etc.) and 
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tlVat each unit will be current and relevant. 
Field testing of career oriented instructional units. 

Preparations are now being made by the teacher who pre- 
pared the unit and at least one other teacher at the same 
level to test the usability of the unit. The third party 
evaluators will also be involved at this point wi*h a pre- 
post instrument. 

Distribution of field tested units. ^ 

^The validated units will be duplicated and made available 
for distribution to public, private and parochial educational 
facilities. Their availability will be publicized after 



Development and Implementation 6f Educational Television 
Series on Elementary Career Education. 

A series of 15 minute televi^js^ion productions are being de- 
veloped by our staff for viewing by metropol itan elementary 
school children in public, private and parochial schools. 

Planning for Two New Career Oriented Secondary Schools. 

The career education staff will continue to meet regularly 
with our advisory council and the planning' committees of 
our soon to be erected schools to guarantee its basic . 
career orientation. 

To estab'1?5^|i a close working relationship with the Minnea- 
polis Career Education Staff. - 

We have established a regularly scheduled inter -city career 
education meetings to share ideas aijd promote dialogue. 
This report will provide our studertts with metropolitan 
wide career orientation. This ^wS 11 also allow us to mobilize 
community resources without regard to artifical city bound- 
• aries . ^ 



successful field testing . 
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EXHIBIT 6.2.2 
SAINT PAUL EVALUATIOhy|EED%. 

Following is an outlliie of ll^aluatioa needs for 1975-76, in- 
eluding evaluation quctstipna an^ methods of measureijiejat: 

Gemini Thrust 
Community Resources V 

a) Was there increased, istaff awareness of community re- 
, sources available through the Gar ee,r Education Depart- 
ment? ■ ■; ■ ^'^ ■ ,. ;■: . ■ /, 
Measurement / ^ : r^Teacher interview and/or survey; 

b) . to what extent' aiiJ -isUff.-^^i^ Gemini cluster utilize 
. Community ReSo.ur:c^ •sj^rvlces'?} * 

■ • .Measurement • , .. A-ijbc 

S ■ ■ ^< /.-^ "-"-■r- '. ■.. ■ ■ / ^ . 

^, ' Media'- ' ^ ^ V .r-:'":^;" 'v. : ' ^ . ■ 

Was careet/orierited Wed^^ for primary, inter- 

• mediate-^ jifhior high; 4nd higjj*^^ a result of 

' V * careet ^{^uc a t ion suppo r t-: ^ '<*/' ' 

» ' Measure^eilt ■ ■ ' '.--Product fox evaluation 

. ••■-■■■'^^^ ■ . ■. , 

Curjiculumt - .. " ^ ' ^' ; 

aj Wa^ ^ co6r^ainated .curriculum progr&m developed and im- 
j ( " plemenj^d?"^ * ^ ' ''^ ' • 

' - Me^surdhent^ ' - --Intervievr Geminf ^:'E. Advisory . 

(?.■■ ^ ' ■ ; ' . Cow-Ac il. < - . 

f&\ ^ *b) Wer&'appropriate-|?fe education iVv^structional materials 
••#<f fojxedch l;ev!pl developed by <(iemini -staff with assistance 

\ ' , > / 0* .t,Ke Giix^|r.:"«^ ..r ' r 

' £,Measure|^n^J^^^^^^ 



i 



i{ :V ',c). Weje te,a^e*rs in th^.tar^t <:lu3te,r i/ivolved in inservice 

■ ' wor^sh0p|fe and pth^r Oi:ientatioft to Care.et Education . 

* v ^ s"t<fategi^es arid c'ori^cepfit's? *. * 
>,5 Mpasuriiyent f . ' 5 - -Evaluations of workshops, logs 

i d) Did tfefi'-j-stlff %a.ke it^If and resourcb materials readily 

^ .V,//"acc;essib4e "to teachers fn Qemini? - • 

ii» jij ^le^surewfenvt ' . --Te^clrer intervi'ew, staff log 

v"' Curriculum — ^'V . 

• : "'a) To»'wiiat eittent were tieacher devel^'^ped materials utilized 

* : ; by staff in th^ dis€rict?i' - / 
v MfeasuremenTt : -Stafff Log^ / 



5 . * . 



eric: 
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b) Was attention given to needs o£ minorities and women 
as related to Career Education materials and programs? 
Measurement --Staff log, product 

/ J 
cj Wete in-service workshops provided to enable teachers 
to open communication with large and--small businesses? 
Measurement --Staff log, evalijations of 

workshops 

Community Resources 

Was there initial and recurring contact with community 
and business organizations? 
Measurement --Staff log 



f 
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^u&iX—--.------. - - ^5.7^_..„,.__.... : _____„... 

PEST COPY AVAILABLE^^^^^ ^'^^ February, I976 

TOs "THE WOf^N m THE GRAY FLANNEL SUIT" SffHI^AR ATTENDEE: 

FROM: LOUISE LOCKETZ AND JEAN DRUKER 
RE: FOLLOW-UP QUESTIONNAIRE 

Last summer you attended the Career Education seminar entitled "The Woman In the 
Gray. Flannel Suit". Because of your Interest w« would anpreclate you answerlno 
the fol lowlnn qtSiesttons: 

i. Would you suanest a sfnllar semfnar this summer? \^ 

<We would aoorecl ate your Vonqest Ions reqardtno fhe format, > 
' 2e Are you more aware of non-sexfst material^ In your teach! no area since you 

attended the seminar? \X t4 

• (Yes) (No) 

3e Have you changed any teachtnn materials or methods to make them non-sexIst? 

U 5 

(Yes) (No) 

If so, what kinds of chanqes have you made? (W^O 

4. Have you done any projects emphaslzlnn women's contributions and chances in the 
woman's role In todav's- soctetv? ^ 

5 . \i 

O (Yes) (No) 

5. Are there materials that you have used or seen that would be helpful In the 
women's study area. Please list and/or share cooles. If possible. 

, . . ■ ( 

6. What have you done to reduce sex-role stereotypinn? 

Have you shared any of the Information that you qathered last summer with any other 

staff members? > \3 3 

^ ^ ^Yes) /no) 

If you want to expanc) on any of your answers to these questions, please feel free 
to do so. Answerlno this questionnaire will be most helpful as we plan another 
seminar this summer. 

Please return this ouestlonnaire to us via school mall: c/o Career Education Resource 

Center— \Mctoria School 

Thank you! — ' 

; P.S. If there are ways that the Career Educatjon Department can be of any helo to you, 
' ^ p I eaiii ca II us at 488-676 1 . . 



KXHIBll 6.2.4 



Your evaluation of the Chamber of Commerce/Career Education Department Seminars is impor- 
flt. This is not a test. There are no right or wrong answers. 

DIRECTIONS: Using the following scale, please record your feelings by circling the appro- 
priate number. • . ' 

'. » 

Strongly Dis- Uncer- Strongl. 
* Disagree Agree tain Agree Agree 



1. The objectives of the seminar were clearly stated.. 

2. The seminar presentations contained new material... 

3. The seminar met my expectations '. 

4. The' seminar increased my knowledge of the St. Paul 
business commjnity 



5. There was a good balance of large and small group 
activity 

6. There has been an increase in comnunity involvt- 
ment in i^y classroom as a result of the seminar.... 

7. Students have benefitted from my attendance at a 
seminar 

There should be. more interaction between the schools 
and the community. 

9. I would recommend attending a Career Education semi- 
nar to a colleague <>.. 



IGL Are. Career Educafion materials available in your schoo 

11, Does your school have a Career Resource. Center? 

12. Do students use the Career Resource Center? 



2 
2 

2 

2 
2 

2 
2 
2 
2 



3 
3 
3 

3 

3 

3 
3 

3 o 
3 



5 
5 
5 

5 

5 

5 

5 

5 

5 



(NeUrj (Occasionally) (Frequently) 
13, Do you refer students to the tareer Resource Center? 



14. Have you used the servlce(s) of the Career Education 
Resource Center at Victoria School? If your answer 
is YES, please specify service(s) used. .Service(s) 



(Never) (Occasionally) (Frequently 
(Yes) (No) 



IS. Are there ways in which the Career Education Resource Center staff can be of help to you? 
Please specify, using the reverse side, if necessary. 



^tease return this survey in the enclosed envelope by 

vou: 
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-NAME 
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SAINT PAUL PJJBLj^ SQXJOLS CAREER EDUCATION RESOURCE CENTER 
QUESTIONNAIRE: CAREER EDUCATION SERVICES, Spring, 1976 

DIRECT ion S: Your taking a few momenta now to provide the information requested 
will be appreciated. 

The following are eervioea available from the Career Education Staff 
at the Career Education Reaource Center ^ 1610 North Victoria. Pleaae 
indicate if you have utilised any of theae aervicea and i&^you would 
like further help in any area* " 



SERVICES: 



Films - 

Filmstrips and Cassettes - 

Coninercial Materials 

Posters ; -* 2 

• Kits 

Bibl iographies - - 

Career Education Hand-outs (Activity ideas) 

Career Education Newsletter 

Bulletin Board Ideas---- 

Career Education Related Units 

St. Paul teacher-developed 

Curriculum guides 

Career Ed Staff School Visitation - 

Staff Assistance in Planning and 

Implanenting Career Ed activities 

Resource People ^ 

Out-of-Classroom experiences 

Interviews r 

Self -Awareness Activities 

Simulations/Rol e- Playing 

Career Fair 

Classroom Presentation--- 

Seminar/Workshop 

Career Rel)sit?d Materials—- 



UTILIZED 


HOW HELPFUL? 

(Please circle) 
Not Very 
Helpful Helpful 


WOULD LIKE 
(MDRE) HELP? 

• 




1 2 3 4 5 






1 2 3 4 5 




• 


1 2 3 4 5 






1 2 3 4 5 






■ 1 2 3 4 5 






.12 3 4 5 






1 2 3 4 5 






1 Z 3 4 5 






1 2 3 4 5 






1 2 3 4 5 






1 2 3 4 5 






1 2 3 4 5 






1 2 3 4 5 






1 2 3 4 5 






1 2 3 4 5 






1 2 3 4 5 






12 3 4 5 






1 2 3 4 5 






1 2 3 4 5 






1 2 3 4 5 






1 2 3 4 5' 





• Hon; else might the staff be of assistance? 

a 

• Would you cite a particularly successful career education activity in which you and your 
Students Diive been involved? 



Please return to: Career Education Resource Center 

Victoria School 
1610 North Victoria 
O THANK lOVl ■ 64 St. Paul, Minnesota 55117 



EXHIBIT 6.3.1 



PURPOSES AND GOALS OF 
MINNEAPOLIS ^EER EDUCATION PROJECT 



Summar^.portions of the Minneapolis project overviews, including 
purposes and goals, pertaining to the second year's evaluation, 
are presented in this Exhibit. ^ 

MINfeAPOLIS PURPOSES AND GOALS 

, — ' ^ 

Purposes 

The basic plan for the Minneapolis Schools is to establish a 
framework for the infusion of career' development into the exist- 
ing K-12 curriculum. The Minneapolis project will focus on in- 
service traiiting to develop knowledge and skills among counselors 
and teachers to help them implement a career education program. 

Major Goals for Minneapolis in Three Years ; ^ 

To establish a framework for the infusion of career development 
into the existing K-12 curriculum. 

> 

To establish a career guidance program designed to complement 
the curriculum in developing in each student posit ive. attitudes 
about the world of work and assisting the student in developing 
career decision making skills. 

To provide teachers, both elementary and secondary, with in- 
service tiine to prepare them to implement in to their dwn class- 
rooms career education techniques, concepts and materials. 

To train a cadre of teachers and counselors who will assist a 
continued in-service training of other teachers and counselors 
in the district . 

p 

To provide teachers and students with current and comprehensive 
information regarding career)5 , life-styles and career opportuni-. 
ties . , 

To facilitate coopieration between schools, community and manpower 
agencies in providlhg a career-oriented program for students. 

To facilitate cooperatiOft between teachers, counselors and 
administrators in providing a pai^eer-or iented program for stu- 
dents. ' 



To identify and adapt curriculum materials which fit the career 
development curriculum framework. 
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EXHIBIT 6.3.2 
MINNEAPOLIS EVALUATIONgNEEDS' 

Following is an outline of preliminary evaluation needs for 

1975-7a, including evaluation questions, suggested methods of 

measureme^i, and evaluator assistance requests: 

Evaluation Question No, 1 ; Were .in-service workshops in career 
education held for Minneftpolis administrators,, counselors, and 
elementary and secondary teachers? 

l)a. Measurement - A log book of workshops kept by project staff 
-indicating number of participants and content of workshop. 
It is anticipated that 210 staff members will participate 
in eight seperate workshops. 

1) b. Evaluator Assistance - Determine content of log book and 

summarize data. ^ — ^""Wf 

Evaluation Question No. 2 : How did the participants in' the in- 
service workshops react to the conduct, content, and activities 
of the workshops? 

2) a. Measurement - Post -prdHkm workshop reaction questionnaire 

for the participants . 

2) b. Evaluator Assistance - Help%*evise the brief questionnaire 

that has been used in the past, and summarize data. 

Evaluation Qttjcst ion No. 3 :' Did the workshop participants show 
increasecl kiiowiedge and understanding of concepts related to 
career e<fucation? 

*■ 

3) a. Measurement - Pre-workshop and post -workshop test 

— ■ ^ 

3) b. Evaluator Assistance - Help revise existing measures, 

determine most appropriate post-test dates, and to analyze 
the data. 

^ - ■ 

Evaluation Question No. 4 : Did the workshop participants show 
improved attitudes toward career education? 

4) a. Measurement - Pre-workshop and post-workshop attitude 

survey, ^cord of voluntary participation of workshop 
participants in career education activities after the 
workshop . 
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4) b. Evaluator Assistance - Help devcilop attitude survey, 

develop record system, determine appropriate post-test 
date, analyze data. 

Evaluation Question Ho. 5 : To what extent did workshop particl- 
pant^ engage in career education act ivities after the workshop 
(classroom, curriculum development, community contacts?) 

5) a. Measurement - Either continuous reqords kept by staff or 

f ol low- up survey . 

5) b. Evaluator; Assistance - Determine most appropriate measure- 

ment technique and analyze data. 

Evaluation Question No. 6 : What other in-service activities 
werte conducted or coordinated by the Minneapolis Public School 
career education project? 

6) a. Measurement - Record of activities. 

6) b. Evaluator Assistance - Help devise record system and 

summarize data. 

Evaluation_Quest ion No. 7 ; To what extent was the Career 
Education Resource Center in the Project Office used by Minnea-^ 
polis staff and students, and how useful was the Resource Center 
to the users? 

7) a. Measurement - Record of participation; brief questionnaire 

to participants. 

7) b. Evaluator Assistance - Help devise record system, develop 

brief questionnaire > and summarize data^ 

Evaluation. Question No . 8 : Did the project staff. make contacts 
with community and business organizations? i 

8) a. Measurement - Record of contacts kept by project staff. 

8) b. Evaluator Assistance - Develop record system and summarize 

data. 

Evaluation Question No. 9 : Did the students who participated 
in intensive classroom activities show improved knowledge, aware- 
ness, and attitudes regarding career education? • 

9) a. Measurement - Pre-test and post-test measures^or about 

16 classroom (4 classes at grades 3, 5, 9, and 12,) 
totaling about 400 to 480 students. 

9)h. Evaluator Assistance - Help with clari^cation of cognitive 
and ^affective objectives,- identification of appropriate 
measures, training of teachers who will administer tests, 
and analysis of data. 
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IlIBIT 6.3,3 



CAHyBR EDUCATION RiiSOUnCK CFKICi: 
Minneftpolin IHiblic School© 

ft 

< 

CARESR DEVLLOPHENT TCIST 

i 

Rtad each question carefully and circle your response on the answer sheet* 

!• '^e term "career" lo beat defined as: 

a) a paid profession or occupation 

b) a s<^rie8 of paid profencions .or occupations 
fc) all lonfj-term roles paid or unpaid - 
d) don*t know 

» \ ■ . . . " 

2« Career Education and Vocational J&!<lucation means .the same iluflFj;. The 
forcnoinp statement is: / 

a) true 
(g) false 

\ • / _ ■. ^ ■ 

>• / It is anticipated that by 19^0 only two out of ion jobs in America will 
require a college de|f;rec# 'Jhe foreffoing statement is: 
io^ ttue ' : 

b) false . . ' 

A« How many times dops the averapo worker chance jobs in hin/her working'career? 
Ji) 1 - 2 ttimofs 

b) 3 • ^ times 

c) ^ - 5 times 

(5) 5-7 tijmes or more 

5« Career education is not trainin/]: for a particular job; but a process that ^ 
- helps students make career decisions* 
^ true 

yi false ^ 

6* Career , education m»iy be infused in the* curriculum qi all subject areaSf K - 1; 
^ true 
b) false 

The Minneapolis Carcor I'Hucation project is desif^ned to increase students* 
av/areness of the many occupatiohn found in society n/ul to' decreaqfe their 
iffnbrance of the world of work t)irouv;h systeiruitic exposure to workers and 
work places. 

true 
b ) false 

■' • ' • • 

8. The career education movement ic primarily oriented to meetin;'; our most 

presffing manpower need.s* Jlie forcfoinj; statement in: . 

a) t^ue 

gjl false 
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IIBIT 6.3.3 

9. In Minnesota, the 1972 M3AT showed^ that ouii)|paduating. seniors were unaware 
of what percentage of jobs for which they.vq[ualified, . 

a) 3o:; ^ • . ' ^ ^ 

b) 50:i " • . ' 

c) 70.0 

10« To facilitate an individuaar*s occupational choice by a process of narrowing 
down the myriad bf possible occupations to a smaller group of similar / 
type of jobs is the purpose of the: 

a) four career education qjodels 

b) eight elements of careier development 
b) school based career education model 

^ fifteen job clusters of the United States Office of Education 
e) none of the ab.ove . ^> 

11. What percenta/;e of t'he chiidron in elementary schools today wil]j||)e employed 
in jobs that do not exist today? ^ ^ . 

a) 20?^ . . ' 1 ■ * 

b) ^o:5 V ^ V 
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12; Women compose hQf^C of tli** work force in the Tnlted *iitates. . 
/5j) true 

^ false ' 



13., In order for an l8-yoar old to enroll in a technical or ^skilled trade 
pro/tram at a Minnesota area vocational-technical institute, they would 
have to pay tuition of: - 

a) 37?0 a year c) a month ^ 

b) 5600 a semester none of these 

1^. The number of individual occupations in the United States is 

a) decreasing . . c) about. 10, 000 ^ 

b) about 5iOOO ' 0 above 30,000 

15« Approximately how many area-vocational tephnical* schools are there in 
Minnesota? - ' ' 

a) 0 - 10 ^ c) n - 30 

b) 11 - 20 . . (S)) more/tha#oO 

16. The Minneapolifs and St. Paul Care^^r .Education projoc"?^ are jointly funded, 
true 

false ' \ 

17. Each individual bcc;iucc of special interests, abilities, and educational 
opportunities is b«.'=5t r>uitod for: 

a) one job ^.'^ c) most jobr> 

a group* of jons -5 d). any job of interest # 

• , * tf ^ <.■■ - 

18. 'in Minneapolis (alone) the nyimber of. unfilled jobs is approximately equal 
to the number of- p^?j^plir seekin^Vwork. 

true' 

b) false 



EXHIBIT 6. 3,3 

19./ Helpinc our ntudenU;; prepare for and \mderstend the future is one important 
element of the Minneapolis Career Education prof-rara. 
true 

b) false . . 



20. The career stereotyping process deals with 

a) v/omen 

b) men ^ 
both of th6 afiove 

d) none of the above 



EXHIBIT 6.3.^ 

CAREER EDUCATION TEAaER SURVEY, 1975-76 
MINhDEAPOLIS PUBLIC SO DDLS 

Pleaae take a feD rninuteB to complete this brief survey regarding the implementation of 
Career Education concepts, during the current school year. The results will be uced to 
help evaluate the existing Cai>eer Education program and to support planning for the 
future. Then^ for ^h activity » indicate whether you spent more, Icsc^ or the same 
ctnount of time this year compared with last year* 

Your ,Nan> e . ' . • 

School ■ ■ Grade/Subject ^_ 

For this school year, estimate the average frequency witJi which you have been using 
each of the following tcdiniques and activities related to career education. There is 
room at the end bf the list fqr you to add other activities you may have been using. 

Compared To 
Frequency ' Previous 
, Activities r Of Use Sdiool Year. 



if- 

Tntnora t"? on of PaTPrr -I'ducation into 

my curriculun 


Q 
0) 

0) 


.0) 

(4 

0) 

s 

♦J 

8 


About Once a y.onth 


A Few TLnes During Year 


iVot Applicable To 
?t>- Students 




Same ^ 


V 
0) 


















2) Use of Carc^cr Related Activities as:# 
films, films trips or multi -media kits 
field trips 
resource people 

group discussion on careers or 
job opportunities 

career related units 

worker interviews 

career related displays or 
bulletin, boards 




































































> 














































3) Are you involved in sclf-au-areness activi- 
ties with your students such as: values 
clarification, DUSO or SRA, interest inven- 
tories, self-awareness units, role playing 


















4) Help from or joint planning with tlie 

care<ir education staff ^ 


















S) Use of library or career center, 
career related materials 


















6) Other 


















7) Other 



















Please Turn to Page Two 
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EXHIfflT 6.3.* 



TEAam OPINIONS 



''3 



V^ing the folloiHng abate ^ pleaee record youx^ oj^niona by circling the number 
eorreeponding to your anawer: 

1 B if you strongly agree with the statement 

2 ■ if you agree with the statcaacnt in general 

3 «" if you are taicertaiji about your feelings 

4 « if you disagree witii the statcjwent 
. ' ^ S ■ if you strongly disagree with the statement 



- The goals of »the career education program in the 
Minn^s^lis schools are clear to me 

- The career education program should involve all 
students and all teachers 

- A sound career education program should emphasize the use 
of coninunity resources outside tlie classrocm 

- A career education program should enable students to 
explore preferences to a depth desired 

- My role as a teacher is that of a facilitator of' 
learning rather than an infoimation giver 

- The interviewing of adults by studei\ts is a vital part 
of tlie career education program 

- TTie careiSr resource staff and office are open and 
willing to help nie 

- I feel that career education activities have helped 
the majority of my students: 

a) become active rather than passive learners 

b) increase their understanding of major occupational 
fields , 

c) stimulate thougJit abeut career choices that are realistic 
d> view education as a continuous process 

e) relate sdiool subjects to knowledge and skills needed 
in the world of work 

'£) clarify misconceptions and stereotypes about certain 
occupations 

g) understand the importance of the 3R's in both school 
and work 

- I believe that the school guidance counselor should be 
involved in the career education program: 

a) in conducting group discussions 

b) in providing materials 

c) in individuiil student's conferences 

d) in assisting teachers integrate career education 
information - ' 

c) in arranging foi* resource persons and career 
educational trips 

f) Other_ 



SAA UD SD 




2 3 4 



2 3 4 



2 3 4 



2 3 4 



2 3 4 



2 3 4 



2 
2 
2 

2 

2 

2 



2 3 4 



m 
CO 

HI 

O 

o 



m 
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EXHIBIT B.S.'* 



Do you feel you understand the terro "Career Education?* 



Yes No Not Sure 



Would you rather see career education taught as a separate element of the 
curriculum instead of trying to integrate it into otlier subject areas? 



Yes No Not Sure 



Do you know who to go to for assistance in planning and implementing 
career education activities? 



Yes No Not Sure 



Have you utilized the materials and/or concepts developed during the workshops? 
Yes No Not Sure 

What factors, if any, would influence you in increasing your involvement in the 
impleraentation of career education activities in your school? 



What suggestions can you make for jjiiproving the implementation of career education 
concepts at your grade level or siijject area? 



What do you think are the biggest problems in impleinenting career education 
activities at your' grade level or subject area? ^ 



^THAM you! 



WEDNESDAY 



THURSDAY 



FRIDAY 



PLEASE RETURN TO PROJECT ADMINISTRATOR THE FOLLOWING MONDAY. 
( USE OTHER SIDE OF SHEET IF, NEEDED ) 



CHECK (XJT SHEET 



Materials 


By Whom 


School 


Date Taken 


Date Returned 






















— ^ f 










s 








































• 








J 




















o- 

, ■ • ■■ 


■ " k 










4 


1 


















J* 


. • •'■ ■ ■ ■ 
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- |-/V>v , ^ 
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^ ^ . EXHIBIT 6.3.7 $ 

CAREER EDUCATION Smmr SIRVEY, SPRING, 1976 

DISECTIOlfS: Pleaae mark the face tliat ehcL^a hoo you feel. There are no right 
or wrong aneuiere. Sxample: * 

dEE££ Disasree 

1 wish they wild serve ice crcaa 
at school. 



FOR 
OFFICE 
USE ONLY 
T 




10 



11 



12 



2. I would likq to see flLns about 
hcfH things are made. 



3. I would li)» to groir up and hav5 
the same type of job as iny 
AOther or father. 



4. Students shcxild fce taught about 
jobs in sdKX)!^ 



S, School shoiQd teach me things I 
can use on a job. 



6. My joh being p. student. 



' 8, I am top^young to tliink about 

v/hat I/want to do vrfien I grow up. 




17 

19 
20 



11 with my 



I feel good abou^ the 
decisions I make in school. 



11, I enjoy intenriodng workers in 
our classroom. ^ 



12. I like to visit businesses azKi 
workers outside of school. 



13. I do some things well that 
would help me on a job. 



14. I would like to work at a 
job when I finish school. 

TBAifx ron: 




